Skip to content
Snippets Groups Projects
Commit db262503 authored by Branislav Jansik's avatar Branislav Jansik
Browse files

Edit capacity-computing.md

parent af5d7f62
Branches
Tags
No related merge requests found
Pipeline #44111 failed
...@@ -8,15 +8,16 @@ achieving the best runtime, throughput, and computer utilization. This is called ...@@ -8,15 +8,16 @@ achieving the best runtime, throughput, and computer utilization. This is called
However, executing a huge number of jobs via the Slurm queue may strain the system. This strain may However, executing a huge number of jobs via the Slurm queue may strain the system. This strain may
result in slow response to commands, inefficient scheduling, and overall degradation of performance result in slow response to commands, inefficient scheduling, and overall degradation of performance
and user experience for all users. We **recommend** using [**Job arrays**][1] or [**HyperQueue**][2] to execute many jobs. and user experience for all users.
We **recommend** using [**Job arrays**][1] or [**HyperQueue**][2] to execute many jobs.
There are two primary scenarios: There are two primary scenarios:
1. Numeber of jobs < 1500, **and** the jobs are able to utilize one or more full nodes: 1. Numeber of jobs < 1500, **and** the jobs are able to utilize one or more **full** nodes:
Use [**Job arrays**][2]. Use [**Job arrays**][2].
The Job array allows to sumbmit and control many jobs (tasks) in one packet. Several job arrays may be sumitted. The Job array allows to sumbmit and control many jobs (tasks) in one packet. Several job arrays may be sumitted.
2. Number of jobs >> 1500, **or** the jobs only utilze a few cores each: 2. Number of jobs >> 1500, **or** the jobs only utilze a **few cores/accelerators** each:
Use [**HyperQueue**][1]. Use [**HyperQueue**][1].
HyperQueue can help efficiently load balance a very large number of (small) jobs amongst available computing nodes. HyperQueue can help efficiently load balance a very large number of (small) jobs amongst available computing nodes.
HyperQueue may be also used if you have dependenices among the jobs. HyperQueue may be also used if you have dependenices among the jobs.
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment