In order to submit jobs in the Stampede cluster at the Texas Advanced Computer Center, you must compile the code there.
In the Makefile:
Make sure that you use the mpif90 compiler.
Uncomment the TACC section in the linking options.
There's no need to load the mkl and/or scalapack module (like in the Lonestar cluster), here they are loaded automatically.
Submitting Jobs
This cluster uses the SLURM batch system, the commands are a little different.
Here is a sample job script from the TACC website:
#!/bin/bash
#SBATCH -J myMPI # job name
#SBATCH -o myMPI.o%j # output and error file name (%j expands to jobID)
#SBATCH -n 32 # total number of mpi tasks requested
#SBATCH -p development # queue (partition) -- normal, development, etc.
#SBATCH -t 01:30:00 # run time (hh:mm:ss) - 1.5 hours
#SBATCH -A nnnn # Project number
#SBATCH --mail-user=your_email_address
#SBATCH --mail-type=begin # email me when the job starts
#SBATCH --mail-type=end # email me when the job finishes
ibrun ./cluster > log.txt # run the MPI executable named cluster
In the line:
#SBATCH -A nnnn # Project number
You must replace nnnn with our research group's project number.
Once this is setup, you submit jobs with:
sbatch job
You can monitor your jobs with:
showq -u username
And kill running jobs with:
scancel jobid