Update nvidia-hip.md

docs.it4i/software/nvidia-hip.md

@@ -4,14 +4,26 @@
 
 ROCm HIP allows developers to convert [CUDA code][a] to portable C++. The same source code can be compiled to run on NVIDIA or AMD GPUs.
 
-This page documents the use of pre-built Singularity/apptainer image on Karolina Accelerated nodes (acn).
+This page documents the use of pre-built Singularity/Apptainer image on Karolina Accelerated nodes (acn).
 
-## Installed Versions of Singularity/apptainer
+## Get Into GPU Node
+
+```console
+qsub  -I  -q qnvidia  -A OPEN-0-0
+ # you get:
+ # qsub: waiting for job 1777777.infra-pbs to start
+ # qsub: job 1777777.infra-pbs ready
+ # $
+```
+
+## Installed Versions of Singularity/Apptainer
 
 For the current list of installed versions, use:
 
 ```console
 module avail apptainer
+# ----------------- /apps/modules/tools ------------------
+#   apptainer-wrappers/1.0 (A)    apptainer/1.1.5
 ```
 
 Load the required module:
@@ -20,18 +32,22 @@ Load the required module:
 module load apptainer/1.1.5
 ```
 
+## Launch Singularity/Apptainer
+
 Run the container:
 
 ```console
 singularity  shell  /home/vic0092/rocm/centos7-nvidia-rocm.sif
 ```
 
-The above gives you Singularity / apptainer shell prompt:
+The above gives you Singularity/Apptainer shell prompt:
 
 ```console
 Singularity>
 ```
 
+## Inside Container
+
 Verify that you have GPUs active and accessible on the given node:
 
 ```console