Skip to content

For Dev

rNLKJA edited this page Mar 14, 2023 · 2 revisions

Before you access, build, deploy or run any code, make sure you obtain your SPARTAN account and acquire your account from KAARAGE.

Typically, spartan uses your student name as the login id and the password set in karrage.

To log in to SPARTAN through running the following command:

ssh [unimelb-username]@spartan.hpc.unimelb.edu.au

# password = karaage password

After login, please check the /data/projeccts/COMP90024/ directory, and make sure you obtain four twitter json files. Please create a soft link for quick access.

One more thing! For better development and testing, you may decide to use the tiny/small JSON files on your own device to save runtime.

Melbourne Research Cloud (MRC)

Visit the following link: https://dashboard.cloud.unimelb.edu.au.

Login using the University of Melbourne credential to authenticate yourself.

Test Benchmark

The application should allow a given number of nodes and cores to be utilized. Specifically, the application should be run once to search the bigTwitter.json file on each of the following resources.

NO. nodes NO. cores
1 1
1 8
2 8 (with 4 cores per node)

Submitting jobs

PLEASE PLEASE PLEASE DO NOT SUBMIT AT THE HEAD NODE, if anything goes wrong it will kill the entire server.

The resources should be set when submitting the search application with the appropriate SLURM options. Note that you should run a single SLURM job *three• separate times on each of the resources given here.

Last words Strongly recommended that you follow the guidelines provided on access and use of the SPARTAN cluster, for more information, please check SPARTAN documentation.