From 78e3f52f478910a9f1fe8b4ba0e18806defdc970 Mon Sep 17 00:00:00 2001
From: Jan Vicherek <jan.vicherek@vsb.cz>
Date: Tue, 17 Jan 2023 11:04:30 +0100
Subject: [PATCH] Update nvidia-hip.md

---
 docs.it4i/software/nvidia-hip.md | 22 +++++++++++++++++++---
 1 file changed, 19 insertions(+), 3 deletions(-)

diff --git a/docs.it4i/software/nvidia-hip.md b/docs.it4i/software/nvidia-hip.md
index 0bb0afa4f..7e62b1a6e 100644
--- a/docs.it4i/software/nvidia-hip.md
+++ b/docs.it4i/software/nvidia-hip.md
@@ -4,14 +4,26 @@
 
 ROCm HIP allows developers to convert [CUDA code][a] to portable C++. The same source code can be compiled to run on NVIDIA or AMD GPUs.
 
-This page documents the use of pre-built Singularity/apptainer image on Karolina Accelerated nodes (acn).
+This page documents the use of pre-built Singularity/Apptainer image on Karolina Accelerated nodes (acn).
 
-## Installed Versions of Singularity/apptainer
+## Get Into GPU Node
+
+```console
+qsub  -I  -q qnvidia  -A OPEN-0-0
+ # you get:
+ # qsub: waiting for job 1777777.infra-pbs to start
+ # qsub: job 1777777.infra-pbs ready
+ # $
+```
+
+## Installed Versions of Singularity/Apptainer
 
 For the current list of installed versions, use:
 
 ```console
 module avail apptainer
+# ----------------- /apps/modules/tools ------------------
+#   apptainer-wrappers/1.0 (A)    apptainer/1.1.5
 ```
 
 Load the required module:
@@ -20,18 +32,22 @@ Load the required module:
 module load apptainer/1.1.5
 ```
 
+## Launch Singularity/Apptainer
+
 Run the container:
 
 ```console
 singularity  shell  /home/vic0092/rocm/centos7-nvidia-rocm.sif
 ```
 
-The above gives you Singularity / apptainer shell prompt:
+The above gives you Singularity/Apptainer shell prompt:
 
 ```console
 Singularity>
 ```
 
+## Inside Container
+
 Verify that you have GPUs active and accessible on the given node:
 
 ```console
-- 
GitLab