@@ -105,19 +105,10 @@ By default, the PBS batch system sends an email only when the job is aborted. Di
...
@@ -105,19 +105,10 @@ By default, the PBS batch system sends an email only when the job is aborted. Di
```console
```console
$qsub -m n
$qsub -m n
```
```
<!--- NOT IMPLEMENTED ON KAROLINA YET
## Advanced Job Placement
## Advanced Job Placement
### Placement by Name
Specific nodes may be allocated via PBS:
```console
$qsub -A OPEN-0-0 -q qprod -lselect=1:host=cn120+1:host=cn121 -I
```
In this example, we allocate the nodes cn120 and cn121, (number of cores depends on the cluster), for 24 hours. Consumed resources will be accounted to the Project identified by Project ID `OPEN-0-0`. The resources will be available interactively.
### Salomon - Placement by Network Location
### Salomon - Placement by Network Location
The network location of allocated nodes in the [InfiniBand network][3] influences efficiency of network communication between nodes of job. Nodes on the same InfiniBand switch communicate faster with lower latency than distant nodes. To improve communication efficiency of jobs, PBS scheduler on Salomon is configured to allocate nodes (from currently available resources), which are as close as possible in the network topology.
The network location of allocated nodes in the [InfiniBand network][3] influences efficiency of network communication between nodes of job. Nodes on the same InfiniBand switch communicate faster with lower latency than distant nodes. To improve communication efficiency of jobs, PBS scheduler on Salomon is configured to allocate nodes (from currently available resources), which are as close as possible in the network topology.
...
@@ -138,90 +129,7 @@ In this example, we request all 9 nodes directly connected to the same switch us
...
@@ -138,90 +129,7 @@ In this example, we request all 9 nodes directly connected to the same switch us
```console
```console
$qsub -A OPEN-0-0 -q qprod -lselect=9 -lplace=group=switch ./myjob
$qsub -A OPEN-0-0 -q qprod -lselect=9 -lplace=group=switch ./myjob
```
```
-->
### Salomon - Placement by Specific InfiniBand Switch
!!! note
Not useful for ordinary computing, suitable for testing and management tasks.
Nodes directly connected to the specific InfiniBand switch can be selected using the PBS resource attribute `switch`.
In this example, we request all 9 nodes directly connected to the r4i1s0sw1 switch.
```console
$qsub -A OPEN-0-0 -q qprod -lselect=9:switch=r4i1s0sw1 ./myjob