From c55c502d9758f67efaa4b12af51fbc00c89e37b3 Mon Sep 17 00:00:00 2001
From: Jan Vicherek <jan.vicherek@vsb.cz>
Date: Tue, 17 Jan 2023 10:24:49 +0100
Subject: [PATCH] Update nvidia-hip.md

---
 docs.it4i/software/nvidia-hip.md | 16 ++++++++++++++++
 1 file changed, 16 insertions(+)

diff --git a/docs.it4i/software/nvidia-hip.md b/docs.it4i/software/nvidia-hip.md
index 0bb0afa4f..55658a2c9 100644
--- a/docs.it4i/software/nvidia-hip.md
+++ b/docs.it4i/software/nvidia-hip.md
@@ -6,20 +6,35 @@ ROCm HIP allows developers to convert [CUDA code][a] to portable C++. The same s
 
 This page documents the use of pre-built Singularity/apptainer image on Karolina Accelerated nodes (acn).
 
+## Get into a GPU node
+
+```console
+qsub  -I  -q qnvidia  -A OPEN-0-0
+ # you get:
+ # qsub: waiting for job 1777777.infra-pbs to start
+ # qsub: job 1777777.infra-pbs ready
+ # $
+```
+
+
 ## Installed Versions of Singularity/apptainer
 
 For the current list of installed versions, use:
 
 ```console
 module avail apptainer
+# ----------------- /apps/modules/tools ------------------
+#   apptainer-wrappers/1.0 (A)    apptainer/1.1.5
 ```
 
+
 Load the required module:
 
 ```console
 module load apptainer/1.1.5
 ```
 
+## Launch Singularity/apptainer
 Run the container:
 
 ```console
@@ -32,6 +47,7 @@ The above gives you Singularity / apptainer shell prompt:
 Singularity>
 ```
 
+## Inside the container
 Verify that you have GPUs active and accessible on the given node:
 
 ```console
-- 
GitLab