Skip to content
Snippets Groups Projects
Commit 7defb29b authored by Roman Sliva's avatar Roman Sliva
Browse files

Update job-scheduling.md

parent c35713c9
No related branches found
No related tags found
No related merge requests found
Pipeline #29152 passed with warnings
...@@ -103,7 +103,9 @@ sbatch -A PROJECT-ID -p p01-arm -N=8 ./script.sh ...@@ -103,7 +103,9 @@ sbatch -A PROJECT-ID -p p01-arm -N=8 ./script.sh
## Partition 02 - Intel (Ice Lake, NVDIMMs + Bitware FPGAs) ## Partition 02 - Intel (Ice Lake, NVDIMMs + Bitware FPGAs)
Partial allocation - per FPGA, resource separation is not enforced. FPGAs are treated as resources. See below for more details about resources.
Partial allocation - per FPGA, resource separation is not enforced.
One FPGA: One FPGA:
...@@ -125,7 +127,9 @@ sbatch -A PROJECT-ID -p p02-intel -N 2 --gres=fpga:2 ./script.sh ...@@ -125,7 +127,9 @@ sbatch -A PROJECT-ID -p p02-intel -N 2 --gres=fpga:2 ./script.sh
## Partition 03 - AMD (Milan, MI100 GPUs + Xilinx FPGAs) ## Partition 03 - AMD (Milan, MI100 GPUs + Xilinx FPGAs)
Partial allocation - per GPU and per FPGA, resource separation is not enforced. GPGPUs and FPGAs are treated as resources. See below for more details about resources.
Partial allocation - per GPGPU and per FPGA, resource separation is not enforced.
One GPU: One GPU:
...@@ -238,7 +242,7 @@ p05-synt01 x86_64,amd,milan,ib,ht ...@@ -238,7 +242,7 @@ p05-synt01 x86_64,amd,milan,ib,ht
``` ```
``` ```
$ salloc -A SERVICE -p p02-intel --constraint noht $ salloc -A PROJECT-ID -p p02-intel --constraint noht
``` ```
``` ```
...@@ -246,4 +250,19 @@ $ scontrol -d show node p02-intel02 | grep ActiveFeatures ...@@ -246,4 +250,19 @@ $ scontrol -d show node p02-intel02 | grep ActiveFeatures
ActiveFeatures=x86_64,intel,icelake,ib,fpga,bitware,nvdimm,noht ActiveFeatures=x86_64,intel,icelake,ib,fpga,bitware,nvdimm,noht
``` ```
## Resources
Slurm supports the ability to define and schedule arbitrary resources - Generic RESources (GRES) in Slurm's terminology. We use GRES for scheduling/allocating GPGPUs and FPGAs.
```
$ scontrol -d show node p03-amd01 | grep Gres=
Gres=gpgpu:amd_mi100:4,fpga:xilinx_alveo_u250:2
$ scontrol -d show node p03-amd02 | grep Gres=
Gres=gpgpu:amd_mi100:4,fpga:xilinx_alveo_u280:2
```
```
$ sbatch -A PROJECT-ID -p p03-amd --gres=fpga:xilinx_alveo_u280:2 ./script.sh
```
[1]: https://slurm.schedmd.com/ [1]: https://slurm.schedmd.com/
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment