diff --git a/docs.it4i/karolina/network.md b/docs.it4i/karolina/network.md index 7981a2afe6709d7f7e91031ea0a5ab2009abfa59..f74d0accb6a26b126ebe5ceef9430d628e87f2a4 100644 --- a/docs.it4i/karolina/network.md +++ b/docs.it4i/karolina/network.md @@ -1,8 +1,8 @@ # Network -All of the compute and login nodes of Karolina are interconnected through an [InfiniBand][a] HDR 200 Gbps network and a Gigabit Ethernet network. +All of the compute and login nodes of Karolina are interconnected through an [InfiniBand][a] HDR 200Gbps network and a gigabit ethernet network. -The Compute network is configured as a non-blocking Fat Tree which consists of 60 x 40-ports Mellanox Quantum™ HDR switches (40 Leaf HDR switches and 20 Spine HDR switches). +The compute network is configured as a non-blocking Fat Tree which consists of 60 x 40-ports Mellanox Quantum™ HDR switches (40 Leaf HDR switches and 20 Spine HDR switches). <br>*For a higher resolution, open the image in a new browser tab.* @@ -11,7 +11,7 @@ Compute nodes and the service infrastructure is connected by the HDR100 technolo **The compute network has the following parameters** * 100Gbps -* Latencies less than 10 microseconds (0.6 μs end-to-end, <90ns switch hop) +* Latencies less than 10 microseconds (0.6μs end-to-end, <90ns switch hop) * Adaptive routing support * MPI communication support * IP protocol support (IPoIB) @@ -19,8 +19,8 @@ Compute nodes and the service infrastructure is connected by the HDR100 technolo ## Mellanox Quantum™ QM8790 40-Ports Switch -Mellanox provides the world’s smartest switch, enabling in-network computing through the Co-Design Scalable Hierarchical Aggregation and Reduction Protocol (SHARP)™ technology. -QM8790 has the highest fabric performance available in the market with up to 16Tb/s of non-blocking bandwidth with sub-130ns port-to-port latency +[Mellanox][b] provides the world’s smartest switch, enabling in-network computing through the Co-Design Scalable Hierarchical Aggregation and Reduction Protocol (SHARP)™ technology. +QM8790 has the highest fabric performance available in the market with up to 16Tb/s of non-blocking bandwidth with sub-130ns port-to-port latency. **Performance** @@ -43,3 +43,4 @@ QM8790 has the highest fabric performance available in the market with up to 16T * VL mapping (VL2VL) [a]: http://en.wikipedia.org/wiki/InfiniBand +[b]: https://network.nvidia.com/files/doc-2020/pb-qm8790.pdf