Node Type Total nodes Slots Per Node Additional Resource Memory Per Node Node Name Prefix Total Cores Login 2 20 none 128GB Wahab 20 Standard Compute 158 40 none 384GB d1-6420a-###
d4-6420b-###
d5-6420b-###
d6-6420b-###6320 GPU 18 28-32 Nvidia V100 GPU (4 per node) 128GB RAM per node + 16GB RAM per GPU d2-w4140a-###
d3-w4140b-###
d4-w4140b-###512 GPU (high memory) 7 64 Nvidia A100 GPU 384GB RAM per node + 80GB RAM per GPU d7-w7525-###
d8-w7525-###
d9-w7525-###448 DGX A100 1 40 Nvidia A100 GPU (8 per node) 512GB RAM + 32GB RAM per GPU Reserved 40 DGX H100 1 112 Nvidia H100 GPU (8 per node) 2TB RAM + 80GB RAM per GPU Reserved 112
The partition on Wahab is defined by machine type. You can find detailed machine information here.Below is the list of partition on Wahab:
Name | Use case | Slurm Submission Options |
---|---|---|
main | no specialized hardware requirement require less than 380GB of total memory per node |
-p main or nothing |
gpu | require GPU accelerator | -p gpu |
high-gpu-mem | require A100 GPU, high gpu memory (80GB), time limited to 7 days | -p high-gpu-mem |
main
partition. Use the -p
switch to run the job on a different partition.--gres gpu:1
salloc -p gpu --gres gpu:1 -c 4
In job script:#SBATCH -p gpu
#SBATCH --gres gpu:1
#SBATCH -c 4
In addition, Wahab has timed partition for each partition above. They are timed-main and timed-gpu
. The differences between the timed partition and their non-timed counterparts are listed below:
Any job can execute on timed partition for a maximum of 2 hours
It will be terminated after 2 hours, thus timed partition are best for short jobs
Any job submitted to timed partition has high priority to start its execution
We believe that if your job is very short, you should not wait for long
Timed partition are larger than non-timed partition
Our investors kindly lend their resources for community use. They agree to let all Wahab users run short tasks on their hardware.
To submit a job to a timed partition, the following options in your submission are mandatory:
-p timed-main|timed-gpu # pick one
Wahab has several mounted storage resources available:
Mount Point | Purpose | Backup |
---|---|---|
/home |
User Home Directory, primary storage for user | yes, once per day |
/RC |
Archive and long term storage, only available to login node | yes, once per day |
/scratch |
Scratch Space (fast) | no |
Compute Platform | # | Hosts | CPU | Memory | Special Features |
---|---|---|---|---|---|
General Purpose | 158 | d1-w6420a-[01-24] d4-w6420b-[01-12] d5-w6420b-[01-24] d6-w6420b-[01-24] e1-w6420b-[02-05,07-24] e2-w6420b-[01-24] e3-w6420b-[01-24] |
Intel(R) Xeon(R) Gold 6148 CPU @ 2.4GHz (40 slots) | 384G | AVX512 |
V100 GPU | 18 | d2-w4140a-### d3-w4140b-### d4-w4140b-### |
Intel(R) Xeon(R) Gold 6130 @ 2.1GHz (32 slots) | 128G | AVX512, 4 x Nvidia Tesla V100 GPU |
A100 GPU | 7 | d7-w7525-### d8-w7525-### d9-w7525-### |
AMD 7543 @ 2.8GHz (64 slots) | 512G | AVX512, 2 x Nvidia Ampere A100 GPU |