-
Lukáš Krupčík authoredLukáš Krupčík authored
tabREPLACE 16.47 KiB
compute nodes number of workers start-up time[s]&|compute nodes|number of workers|start-up time[s]|
--------------- ------------------- --------------------&|---|---|---|
16 384 831&|16|384|831|
8 192 807&|8|192|807|
4 96 483&|4|96|483|
2 48 16&|2|48|16|
Node type Count Range Memory Cores [Access](resource-allocation-and-job-execution/resources-allocation-policy.html)&|Node type|Count|Range|Memory|Cores|[Access](resource-allocation-and-job-execution/resources-allocation-policy.html)|
---------------------------- ------- --------------- -------- ------------- --------------------------------------------------------------------------------------------------&|---|---|---|---|---|---|
Nodes without accelerator 180 cn[1-180] 64GB 16 @ 2.4Ghz qexp, qprod, qlong, qfree&|Nodes without accelerator|180|cn[1-180]|64GB|16 @ 2.4Ghz|qexp, qprod, qlong, qfree|
Nodes with GPU accelerator 23 cn[181-203] 96GB 16 @ 2.3Ghz qgpu, qprod&|Nodes with GPU accelerator|23|cn[181-203]|96GB|16 @ 2.3Ghz|qgpu, qprod|
Nodes with MIC accelerator 4 cn[204-207] 96GB 16 @ 2.3GHz qmic, qprod&|Nodes with MIC accelerator|4|cn[204-207]|96GB|16 @ 2.3GHz|qmic, qprod|
Fat compute nodes 2 cn[208-209] 512GB 16 @ 2.4GHz qfat, qprod&|Fat compute nodes|2|cn[208-209]|512GB|16 @ 2.4GHz|qfat, qprod|
Node Processor Memory Accelerator&|Node|Processor|Memory|Accelerator|
------------------ --------------------------------------- -------- ----------------------&|---|---|---|---|
w/o accelerator 2x Intel Sandy Bridge E5-2665, 2.4GHz 64GB -&|w/o accelerator|2x Intel Sandy Bridge E5-2665, 2.4GHz|64GB|-|
GPU accelerated 2x Intel Sandy Bridge E5-2470, 2.3GHz 96GB NVIDIA Kepler K20&|GPU accelerated|2x Intel Sandy Bridge E5-2470, 2.3GHz|96GB|NVIDIA Kepler K20|
MIC accelerated 2x Intel Sandy Bridge E5-2470, 2.3GHz 96GB Intel Xeon Phi P5110&|MIC accelerated|2x Intel Sandy Bridge E5-2470, 2.3GHz|96GB|Intel Xeon Phi P5110|
Fat compute node 2x Intel Sandy Bridge E5-2665, 2.4GHz 512GB -&|Fat compute node|2x Intel Sandy Bridge E5-2665, 2.4GHz|512GB|-|
Login address Port Protocol Login node&|Login address|Port|Protocol|Login node|
------------------------ ------ ---------- -----------------------------------------&|---|---|---|---|
salomon.it4i.cz 22 ssh round-robin DNS record for login[1-4]&|salomon.it4i.cz|22|ssh|round-robin DNS record for login[1-4]|
login1.salomon.it4i.cz 22 ssh login1&|login1.salomon.it4i.cz|22|ssh|login1|
login2.salomon.it4i.cz 22 ssh login2&|login1.salomon.it4i.cz|22|ssh|login1|
login3.salomon.it4i.cz 22 ssh login3&|login1.salomon.it4i.cz|22|ssh|login1|
login4.salomon.it4i.cz 22 ssh login4&|login1.salomon.it4i.cz|22|ssh|login1|
Toolchain Module(s)&|Toolchain|Module(s)|
-------------------- ------------------------------------------------&|---|----|
GCC GCC&|GCC|GCC|
ictce icc, ifort, imkl, impi&|ictce|icc, ifort, imkl, impi|
intel GCC, icc, ifort, imkl, impi&|intel|GCC, icc, ifort, imkl, impi|
gompi GCC, OpenMPI&|gompi|GCC, OpenMPI|
goolf BLACS, FFTW, GCC, OpenBLAS, OpenMPI, ScaLAPACK&|goolf|BLACS, FFTW, GCC, OpenBLAS, OpenMPI, ScaLAPACK|
>iompi OpenMPI, icc, ifort&|iompi|OpenMPI, icc, ifort|
iccifort icc, ifort&|iccifort|icc, ifort|
Login address Port Protocol Login node& |Login address|Port|Protocol|Login node|
------------------------------ ------ ---------- ----------------------------------& |---|---|
salomon-prace.it4i.cz 2222 gsissh login1, login2, login3 or login4& |salomon-prace.it4i.cz|2222|gsissh|login1, login2, login3 or login4|
login1-prace.salomon.it4i.cz 2222 gsissh login1& |login1-prace.salomon.it4i.cz|2222|gsissh|login1|
login2-prace.salomon.it4i.cz 2222 gsissh login2& |login2-prace.salomon.it4i.cz|2222|gsissh|login2|
login3-prace.salomon.it4i.cz 2222 gsissh login3& |login3-prace.salomon.it4i.cz|2222|gsissh|login3|
login4-prace.salomon.it4i.cz 2222 gsissh login4& |login4-prace.salomon.it4i.cz|2222|gsissh|login4|
|Login address|Port|Protocol|Login node|& |Login address|Port|Protocol|Login node|
------------------------ ------ ---------- ----------------------------------& |---|---|
salomon.it4i.cz 2222 gsissh login1, login2, login3 or login4& |salomon.it4i.cz|2222|gsissh|login1, login2, login3 or login4|
login1.salomon.it4i.cz 2222 gsissh login1& |login1.salomon.it4i.cz|2222|gsissh|login1|
login2.salomon.it4i.cz 2222 gsissh login2& |login2-prace.salomon.it4i.cz|2222|gsissh|login2|
login3.salomon.it4i.cz 2222 gsissh login3& |login3-prace.salomon.it4i.cz|2222|gsissh|login3|
login4.salomon.it4i.cz 2222 gsissh login4& |login4-prace.salomon.it4i.cz|2222|gsissh|login4|
Login address Port Node role& |Login address|Port|Node role|
------------------------------- ------ -----------------------------& |---|---|
gridftp-prace.salomon.it4i.cz 2812 Front end /control server& |gridftp-prace.salomon.it4i.cz|2812|Front end /control server|
lgw1-prace.salomon.it4i.cz 2813 Backend / data mover server& |lgw1-prace.salomon.it4i.cz|2813|Backend / data mover server|
lgw2-prace.salomon.it4i.cz 2813 Backend / data mover server& |lgw2-prace.salomon.it4i.cz|2813|Backend / data mover server|
lgw3-prace.salomon.it4i.cz 2813 Backend / data mover server& |lgw3-prace.salomon.it4i.cz|2813|Backend / data mover server|
Login address Port Node role& |Login address|Port|Node role|
------------------------- ------ -----------------------------& |---|---|
gridftp.salomon.it4i.cz 2812 Front end /control server& |gridftp.salomon.it4i.cz|2812|Front end /control server|
lgw1.salomon.it4i.cz 2813 Backend / data mover server& |lgw1.salomon.it4i.cz|2813|Backend / data mover server|
lgw2.salomon.it4i.cz 2813 Backend / data mover server& |lgw2.salomon.it4i.cz|2813|Backend / data mover server|
lgw3.salomon.it4i.cz 2813 Backend / data mover server& |lgw3.salomon.it4i.cz|2813|Backend / data mover server|
File system mount point Filesystem Comment& |File system mount point|Filesystem|Comment|
------------------------- ------------ ----------------------------------------------------------------& |---|---|
/home Lustre Default HOME directories of users in format /home/prace/login/& |/home|Lustre|Default HOME directories of users in format /home/prace/login/|
/scratch Lustre Shared SCRATCH mounted on the whole cluster& |/scratch|Lustre|Shared SCRATCH mounted on the whole cluster|
Data type Default path& |Data type|Default path|
------------------------------ ---------------------------------& |---|---|
large project files /scratch/work/user/prace/login/& |large project files|/scratch/work/user/prace/login/|
large scratch/temporary data /scratch/temp/& |large scratch/temporary data|/scratch/temp/|
---------------------------------------------------------------------------------------------------------------------------------------------&
queue Active project Project resources Nodes priority authorization walltime&|queue|Active project|Project resources|Nodes|priority|authorization|walltime default/max| default/max&
--------------------- -|---|---|---|--------------------- ---------- --------------- -------------&|---|---|
**qexp** no none required 32 nodes, max 8 per user 150 no 1 / 1h& |**qexp** Express queue|no|none required|32 nodes, max 8 per user|150|no|1 / 1h|
Express queue&\\
**qprace** yes > 0 >1006 nodes, max 86 per job 0 no 24 / 48h&|**qprace** Production queue|yes|> 0|1006 nodes, max 86 per job|0|no|24 / 48h|
Production queue&\\
**qfree** yes none required 752 nodes, max 86 per job -1024 no 12 / 12h&|**qfree** Free resource queue|yes|none required|752 nodes, max 86 per job|-1024|no|12 / 12h|
Free resource queue&\\
---------------------------------------------------------------------------------------------------------------------------------------------&
Port Protocol& |Port|Protocol|
------ ----------& |---|---|
22 ssh& |22|ssh|
80 http& |80|http|
443 https& |443|https|
9418 git& |9418|git|
Node Count Processor Cores Memory Accelerator& |Node|Count|Processor|Cores|Memory|Accelerator|
----------------- ------- ---------------------------------- ------- -------- --------------------------------------------& |---|---|
w/o accelerator 576 2x Intel Xeon E5-2680v3, 2.5GHz 24 128GB -& |w/o accelerator|576|2x Intel Xeon E5-2680v3, 2.5GHz|24|128GB|-|
MIC accelerated 432 2x Intel Xeon E5-2680v3, 2.5GHz 24 128GB 2x Intel Xeon Phi 7120P, 61cores, 16GB RAM& |MIC accelerated|432|2x Intel Xeon E5-2680v3, 2.5GHz|24|128GB|2x Intel Xeon Phi 7120P, 61cores, 16GB RAM|
Node Count Processor Cores Memory GPU Accelerator& |Node|Count|Processor|Cores|Memory|GPU Accelerator|
--------------- ------- --------------------------------- ------- -------- ------------------------------& |---|---|
visualization 2 2x Intel Xeon E5-2695v3, 2.3GHz 28 512GB NVIDIA QUADRO K5000, 4GB RAM& |visualization|2|2x Intel Xeon E5-2695v3, 2.3GHz|28|512GB|NVIDIA QUADRO K5000, 4GB RAM|
Hypercube dimension& |Hypercube|dimension|
--------------------- -------------------------------------------& |---|---|
1D ehc_1d& |1D|ehc_1d|
2D ehc_2d& |2D|ehc_2d|
3D ehc_3d& |3D|ehc_3d|
4D ehc_4d& |4D|ehc_4d|
5D ehc_5d& |5D|ehc_5d|
6D ehc_6d& |6D|ehc_6d|
7D ehc_7d& |7D|ehc_7d|
Node type Count Short name Long name Rack& |Node type|Count|Short name|Long name|Rack|
-------------------------------------- ------- ------------------ -------------------------- -------& |---|---|
M-Cell compute nodes w/o accelerator 576 cns1 -cns576 r1i0n0 - r4i7n17 1-4& |M-Cell compute nodes w/o accelerator|576|cns1 -cns576|r1i0n0 - r4i7n17|1-4|
compute nodes MIC accelerated 432 cns577 - cns1008 r21u01n577 - r37u31n1008 21-38& |compute nodes MIC accelerated|432|cns577 - cns1008|r21u01n577 - r37u31n1008|21-38|
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------&
Mountpoint Usage Protocol Net Capacity Throughput Limitations Access Services& |Mountpoint|Usage|Protocol|Net|Capacity|Throughput|Limitations|Access|
---------------------------------------------- -------------------------------- ------------- -------------- ------------ ------------- ------------------------- -----------------------------& |---|---|
/home home directory NFS, 2-Tier 0.5 PB 6 GB/s Quota 250GB Compute and login nodes backed up&| /home|home directory|NFS, 2-Tier|0.5 PB|6 GB/s|Quota 250GB|Compute and login nodes|backed up|
/scratch/work large project files Lustre 1.69 PB 30 GB/s Quota Compute and login nodes none& |/scratch/work|large project files|Lustre|1.69 PB|30 GB/s|Quota|Compute and login nodes|none|
1TB&
/scratch/temp job temporary data Lustre 1.69 PB 30 GB/s Quota 100TB Compute and login nodes files older 90 days removed& |/scratch/temp|job temporary data|Lustre|1.69 PB|30 GB/s|Quota 100TB|Compute and login nodes|files older 90 days removed|
/ramdisk job temporary data, node local local 120GB 90 GB/s none Compute nodes purged after job ends& |/ramdisk|job temporary data, node local|local|120GB|90 GB/s|none|Compute nodes|purged after job ends|
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------&
Application Version module& |Application|Version|module|
------------- -------------- ---------------------& |---|---|
**R** R 3.1.1 R/3.1.1-intel-2015b& |**R**|R 3.1.1|R/3.1.1-intel-2015b|
**Rstudio** Rstudio 0.97 Rstudio& |**Rstudio**|Rstudio 0.97|Rstudio|
24 MPI**&**24 MPI**
--------------- -----------------------& |**Version**|**Module**|
**Version** **Module**& |---|---|
2016 Update 2 Advisor/2016_update2& |2016 Update 2|Advisor/2016_update2|
2016 Update 1 Inspector/2016_update1& |2016 Update 1|Inspector/2016_update1|
Interface Integer type& |Interface|Integer type|
----------- -----------------------------------------------& |---|---|
LP64 32-bit, int, integer(kind=4), MPI_INT& |LP64|32-bit, int, integer(kind=4), MPI_INT|
ILP64 64-bit, long int, integer(kind=8), MPI_INT64 & |ILP64|64-bit, long int, integer(kind=8), MPI_INT64|
Parameter Value& |Parameter|Value|
------------------------------------------------- -----------------------------& |---|---|
>max number of atoms 200& |max number of atoms|200|
>max number of valence orbitals 300& |max number of valence orbitals|300|
>max number of basis functions 4095& |max number of basis functions|4095|
>max number of states per symmmetry 20& |max number of states per symmmetry|20|
>max number of state symmetries 16& |max number of state symmetries|16|
>max number of records 200& |max number of records|200|
>max number of primitives >maxbfn x [2]& |max number of primitives|maxbfn x [2]|
Address Port Protocol& |Address|Port|Protocol|
-------------------------------------------------- ---------------------------------- -----------------------------------------& |---|---|
anselm.it4i.cz 22 scp, sftp& |anselm.it4i.cz|22|scp, sftp|
login1.anselm.it4i.cz 22 scp, sftp& |login1.anselm.it4i.cz|22|scp, sftp| login2.anselm.it4i.cz 22 scp, sftp& |login2.anselm.it4i.cz|22|scp, sftp|
class="discreet">dm1.anselm.it4i.cz 22 class="discreet">scp, sftp</span>& |dm1.anselm.it4i.cz|22|scp, sftp|
Login address Port Protocol Login node& |Login address|Port|Protocol|Login node|
----------------------- ------ ---------- ----------------------------------------------& |---|----|
anselm.it4i.cz 22 ssh round-robin DNS record for login1 and login2& |anselm.it4i.cz|22|ssh|round-robin DNS record for login1 and login2|
login1.anselm.it4i.cz 22 ssh login1& |login1.anselm.it4i.cz|22|ssh|login1|
login2.anselm.it4i.cz 22 ssh login2& |login2.anselm.it4i.cz|22|ssh|login2|