From 97cf914f137554075c7b19d081c74c1dc65b3b34 Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?Roman=20Sl=C3=ADva?= <roman.sliva@vsb.cz>
Date: Mon, 4 Sep 2023 13:15:09 +0200
Subject: [PATCH] Content, content

---
 docs.it4i/general/karolina-slurm.md | 53 +++++++++++++++++++++++++++--
 1 file changed, 50 insertions(+), 3 deletions(-)

diff --git a/docs.it4i/general/karolina-slurm.md b/docs.it4i/general/karolina-slurm.md
index 3cddafaea..73a50554e 100644
--- a/docs.it4i/general/karolina-slurm.md
+++ b/docs.it4i/general/karolina-slurm.md
@@ -32,21 +32,68 @@ at [https://extranet.it4i.cz/rsweb/karolina][3]
 
 On Karolina cluster
 
-* all cpu queues/partitions provide full node allocation, whole nodes are allocated to job
-* other queues/partitions (gpu, fat, viz) provide partial node allocation
+* all cpu queues/partitions provide full node allocation, whole nodes (all node resources) are allocated to a job.
+* other queues/partitions (gpu, fat, viz) provide partial node allocation. Jobs' resources (cpu, mem) are separated and dedicated for job.
 
 ## Using CPU Queues
 
 ```console
-$ salloc -A PROJECT-ID -p qcpu
+#!/usr/bin/bash
+#SBATCH --job-name MyJobName
+#SBATCH --account PROJECT-ID
+#SBATCH --partition qcpu
+#SBATCH --time 2:00:00
+...
 ```
 
 ## Using GPU Queues
 
+
 ## Using Fat Queue
 
+Access [data analytics node aka fat][6].
+Fat node is divided into 32 fractions, one fraction per CPU. By default only one fraction i.e. 1/32 of the node - one CPU and corresponding memory is allocated.
+
+```console
+#!/usr/bin/bash
+#SBATCH --job-name MyJobName
+#SBATCH --account PROJECT-ID
+#SBATCH --partition qfat
+#SBATCH --time 2:00:00
+...
+```
+To allocate requested memory use `--mem` option. Corresponding CPUs wil be allocated. Fat node has about 23TB of memory available for jobs.
+
+```console
+#SBATCH --mem 6TB
+```
+
+To allocate whole fat node use `--exclusive` option
+
+```console
+#SBATCH --exclusive
+...
+```
+
 ## Using Viz Queue
 
+Access [visualisation node][7].
+Every visualisation node is divided into eight fractions. By default only one fraction i.e. 1/8 of the node is allocated.
+
+```console
+$ salloc -A PROJECT-ID -p qviz
+```
+
+To allocate whole visualisation node use `--exclusive` option
+
+```console
+$ salloc -A PROJECT-ID -p qviz --exclusive
+```
+
 [1]: https://slurm.schedmd.com/
 [2]: /general/slurm-job-submission-and-execution
 [3]: https://extranet.it4i.cz/rsweb/karolina
+[4]: /karolina/compute-nodes/#compute-nodes-without-accelerators
+[5]: /karolina/compute-nodes/#compute-nodes-with-a-gpu-accelerator
+[6]: /karolina/compute-nodes/#data-analytics-compute-node
+[7]: /karolina/visualization/
-- 
GitLab