All of the compute and login nodes of Karolina are interconnected through an [InfiniBand][a] HDR 200Gbps network and a Gigabit Ethernet network.
All of the compute and login nodes of Karolina are interconnected through an [InfiniBand][a] HDR 200Gbps network and a gigabit ethernet network.
The Compute network is configured as a non-blocking Fat Tree which consists of 60 x 40-ports Mellanox Quantum™ HDR switches (40 Leaf HDR switches and 20 Spine HDR switches).
The compute network is configured as a non-blocking Fat Tree which consists of 60 x 40-ports Mellanox Quantum™ HDR switches (40 Leaf HDR switches and 20 Spine HDR switches).
<br>*For a higher resolution, open the image in a new browser tab.*
...
...
@@ -11,7 +11,7 @@ Compute nodes and the service infrastructure is connected by the HDR100 technolo
**The compute network has the following parameters**
* 100Gbps
* Latencies less than 10 microseconds (0.6μs end-to-end, <90ns switch hop)
* Latencies less than 10 microseconds (0.6μs end-to-end, <90ns switch hop)
* Adaptive routing support
* MPI communication support
* IP protocol support (IPoIB)
...
...
@@ -19,8 +19,8 @@ Compute nodes and the service infrastructure is connected by the HDR100 technolo
## Mellanox Quantum™ QM8790 40-Ports Switch
Mellanox provides the world’s smartest switch, enabling in-network computing through the Co-Design Scalable Hierarchical Aggregation and Reduction Protocol (SHARP)™ technology.
QM8790 has the highest fabric performance available in the market with up to 16Tb/s of non-blocking bandwidth with sub-130ns port-to-port latency
[Mellanox][b] provides the world’s smartest switch, enabling in-network computing through the Co-Design Scalable Hierarchical Aggregation and Reduction Protocol (SHARP)™ technology.
QM8790 has the highest fabric performance available in the market with up to 16Tb/s of non-blocking bandwidth with sub-130ns port-to-port latency.
**Performance**
...
...
@@ -43,3 +43,4 @@ QM8790 has the highest fabric performance available in the market with up to 16T
