Skip to content
Snippets Groups Projects
tabREPLACE 16.5 KiB
Newer Older
Lukáš Krupčík's avatar
Lukáš Krupčík committed
  compute nodes   number of workers   start-up time[s]&|compute nodes|number of workers|start-up time[s]|
  --------------- ------------------- --------------------&|---|---|---|
  16              384                 831&|16|384|831|
  8               192                 807&|8|192|807|
  4               96                  483&|4|96|483|
  2               48                  16&|2|48|16|
  Node type                    Count   Range           Memory   Cores         [Access](resource-allocation-and-job-execution/resources-allocation-policy.html)&|Node type|Count|Range|Memory|Cores|[Access](resource-allocation-and-job-execution/resources-allocation-policy.html)|
  ---------------------------- ------- --------------- -------- ------------- --------------------------------------------------------------------------------------------------&|---|---|---|---|---|---|
  Nodes without accelerator    180     cn[1-180]     64GB     16 @ 2.4Ghz   qexp, qprod, qlong, qfree&|Nodes without accelerator|180|cn[1-180]|64GB|16 @ 2.4Ghz|qexp, qprod, qlong, qfree|
  Nodes with GPU accelerator   23      cn[181-203]   96GB     16 @ 2.3Ghz   qgpu, qprod&|Nodes with GPU accelerator|23|cn[181-203]|96GB|16 @ 2.3Ghz|qgpu, qprod|
  Nodes with MIC accelerator   4       cn[204-207]   96GB     16 @ 2.3GHz   qmic, qprod&|Nodes with MIC accelerator|4|cn[204-207]|96GB|16 @ 2.3GHz|qmic, qprod|
  Fat compute nodes            2       cn[208-209]   512GB    16 @ 2.4GHz   qfat, qprod&|Fat compute nodes|2|cn[208-209]|512GB|16 @ 2.4GHz|qfat, qprod|
  Node               Processor                               Memory   Accelerator&|Node|Processor|Memory|Accelerator|
  ------------------ --------------------------------------- -------- ----------------------&|---|---|---|---|
  w/o accelerator    2x Intel Sandy Bridge E5-2665, 2.4GHz   64GB     -&|w/o accelerator|2x Intel Sandy Bridge E5-2665, 2.4GHz|64GB|-|
  GPU accelerated    2x Intel Sandy Bridge E5-2470, 2.3GHz   96GB     NVIDIA Kepler K20&|GPU accelerated|2x Intel Sandy Bridge E5-2470, 2.3GHz|96GB|NVIDIA Kepler K20|
  MIC accelerated    2x Intel Sandy Bridge E5-2470, 2.3GHz   96GB     Intel Xeon Phi P5110&|MIC accelerated|2x Intel Sandy Bridge E5-2470, 2.3GHz|96GB|Intel Xeon Phi P5110|
  Fat compute node   2x Intel Sandy Bridge E5-2665, 2.4GHz   512GB    -&|Fat compute node|2x Intel Sandy Bridge E5-2665, 2.4GHz|512GB|-|
  Login address            Port   Protocol   Login node&|Login address|Port|Protocol|Login node|
  ------------------------ ------ ---------- -----------------------------------------&|---|---|---|---|
  salomon.it4i.cz          22     ssh        round-robin DNS record for login[1-4]&|salomon.it4i.cz|22|ssh|round-robin DNS record for login[1-4]|
  login1.salomon.it4i.cz   22     ssh        login1&|login1.salomon.it4i.cz|22|ssh|login1|
  login2.salomon.it4i.cz   22     ssh        login2&|login1.salomon.it4i.cz|22|ssh|login1|
  login3.salomon.it4i.cz   22     ssh        login3&|login1.salomon.it4i.cz|22|ssh|login1|
  login4.salomon.it4i.cz   22     ssh        login4&|login1.salomon.it4i.cz|22|ssh|login1|
  Toolchain            Module(s)&|Toolchain|Module(s)|
  -------------------- ------------------------------------------------&|---|----|
  GCC                  GCC&|GCC|GCC|
  ictce                icc, ifort, imkl, impi&|ictce|icc, ifort, imkl, impi|
  intel                GCC, icc, ifort, imkl, impi&|intel|GCC, icc, ifort, imkl, impi|
  gompi                GCC, OpenMPI&|gompi|GCC, OpenMPI|
  goolf                BLACS, FFTW, GCC, OpenBLAS, OpenMPI, ScaLAPACK&|goolf|BLACS, FFTW, GCC, OpenBLAS, OpenMPI, ScaLAPACK|
  >iompi   OpenMPI, icc, ifort&|iompi|OpenMPI, icc, ifort|
  iccifort             icc, ifort&|iccifort|icc, ifort|
Lukáš Krupčík's avatar
Lukáš Krupčík committed
  Login address                  Port   Protocol   Login node&  |Login address|Port|Protocol|Login node|
  ------------------------------ ------ ---------- ----------------------------------&  |---|---|
  salomon-prace.it4i.cz          2222   gsissh     login1, login2, login3 or login4&  |salomon-prace.it4i.cz|2222|gsissh|login1, login2, login3 or login4|
  login1-prace.salomon.it4i.cz   2222   gsissh     login1&  |login1-prace.salomon.it4i.cz|2222|gsissh|login1|
  login2-prace.salomon.it4i.cz   2222   gsissh     login2&  |login2-prace.salomon.it4i.cz|2222|gsissh|login2|
  login3-prace.salomon.it4i.cz   2222   gsissh     login3&  |login3-prace.salomon.it4i.cz|2222|gsissh|login3|
  login4-prace.salomon.it4i.cz   2222   gsissh     login4&  |login4-prace.salomon.it4i.cz|2222|gsissh|login4|
  |Login address|Port|Protocol|Login node|&  |Login address|Port|Protocol|Login node|
  ------------------------ ------ ---------- ----------------------------------&  |---|---|
  salomon.it4i.cz          2222   gsissh     login1, login2, login3 or login4&  |salomon.it4i.cz|2222|gsissh|login1, login2, login3 or login4|
  login1.salomon.it4i.cz   2222   gsissh     login1&  |login1.salomon.it4i.cz|2222|gsissh|login1|
  login2.salomon.it4i.cz   2222   gsissh     login2&  |login2-prace.salomon.it4i.cz|2222|gsissh|login2|
  login3.salomon.it4i.cz   2222   gsissh     login3&  |login3-prace.salomon.it4i.cz|2222|gsissh|login3|
  login4.salomon.it4i.cz   2222   gsissh     login4&  |login4-prace.salomon.it4i.cz|2222|gsissh|login4|
  Login address                   Port   Node role&  |Login address|Port|Node role|
  ------------------------------- ------ -----------------------------&  |---|---|
  gridftp-prace.salomon.it4i.cz   2812   Front end /control server&  |gridftp-prace.salomon.it4i.cz|2812|Front end /control server|
  lgw1-prace.salomon.it4i.cz      2813   Backend / data mover server&  |lgw1-prace.salomon.it4i.cz|2813|Backend / data mover server|
  lgw2-prace.salomon.it4i.cz      2813   Backend / data mover server&  |lgw2-prace.salomon.it4i.cz|2813|Backend / data mover server|
  lgw3-prace.salomon.it4i.cz      2813   Backend / data mover server&  |lgw3-prace.salomon.it4i.cz|2813|Backend / data mover server|
  Login address             Port   Node role&  |Login address|Port|Node role|
  ------------------------- ------ -----------------------------&  |---|---|
  gridftp.salomon.it4i.cz   2812   Front end /control server&  |gridftp.salomon.it4i.cz|2812|Front end /control server|
  lgw1.salomon.it4i.cz      2813   Backend / data mover server&  |lgw1.salomon.it4i.cz|2813|Backend / data mover server|
  lgw2.salomon.it4i.cz      2813   Backend / data mover server&  |lgw2.salomon.it4i.cz|2813|Backend / data mover server|
  lgw3.salomon.it4i.cz      2813   Backend / data mover server&  |lgw3.salomon.it4i.cz|2813|Backend / data mover server|
  File system mount point   Filesystem   Comment&  |File system mount point|Filesystem|Comment|
  ------------------------- ------------ ----------------------------------------------------------------&  |---|---|
  /home                     Lustre       Default HOME directories of users in format /home/prace/login/&  |/home|Lustre|Default HOME directories of users in format /home/prace/login/|
  /scratch                  Lustre       Shared SCRATCH mounted on the whole cluster&  |/scratch|Lustre|Shared SCRATCH mounted on the whole cluster|
  Data type                      Default path&  |Data type|Default path|
  ------------------------------ ---------------------------------&  |---|---|
  large project files            /scratch/work/user/prace/login/&  |large project files|/scratch/work/user/prace/login/|
  large scratch/temporary data   /scratch/temp/&  |large scratch/temporary data|/scratch/temp/|
  ---------------------------------------------------------------------------------------------------------------------------------------------&
  queue                 Active project   Project resources   Nodes                                     priority   authorization   walltime&|queue|Active project|Project resources|Nodes|priority|authorization|walltime default/max|
                                                                                                                                  default/max&
  --------------------- -|---|---|---|--------------------- ---------- --------------- -------------&|---|---|
  **qexp**             no               none required       32 nodes, max 8 per user                  150        no              1 / 1h& |**qexp** Express queue|no|none required|32 nodes, max 8 per user|150|no|1 / 1h|
  Express queue&\\                                                                                                                   
  **qprace**           yes             > 0              >1006 nodes, max 86 per job   0          no              24 / 48h&|**qprace** Production queue|yes|> 0|1006 nodes, max 86 per job|0|no|24 / 48h|
  Production queue&\\                                                                                                                                                                                                                                              
  **qfree**            yes              none required       752 nodes, max 86 per job                 -1024      no              12 / 12h&|**qfree** Free resource queue|yes|none required|752 nodes, max 86 per job|-1024|no|12 / 12h|
  Free resource queue&\\                                                                                                             
  ---------------------------------------------------------------------------------------------------------------------------------------------&
  Port   Protocol&  |Port|Protocol|
  ------ ----------&  |---|---|
  22     ssh&  |22|ssh|
  80     http&  |80|http|
  443    https&  |443|https|
  9418   git&  |9418|git|
  Node              Count   Processor                          Cores   Memory   Accelerator&  |Node|Count|Processor|Cores|Memory|Accelerator|
  ----------------- ------- ---------------------------------- ------- -------- --------------------------------------------&  |---|---|
  w/o accelerator   576     2x Intel Xeon E5-2680v3, 2.5GHz    24      128GB    -&  |w/o accelerator|576|2x Intel Xeon E5-2680v3, 2.5GHz|24|128GB|-|
  MIC accelerated   432     2x Intel Xeon E5-2680v3, 2.5GHz    24      128GB    2x Intel Xeon Phi 7120P, 61cores, 16GB RAM&  |MIC accelerated|432|2x Intel Xeon E5-2680v3, 2.5GHz|24|128GB|2x Intel Xeon Phi 7120P, 61cores, 16GB RAM|
  Node            Count   Processor                         Cores   Memory   GPU Accelerator&  |Node|Count|Processor|Cores|Memory|GPU Accelerator|
  --------------- ------- --------------------------------- ------- -------- ------------------------------&  |---|---|
  visualization   2       2x Intel Xeon E5-2695v3, 2.3GHz   28      512GB    NVIDIA QUADRO K5000, 4GB RAM&  |visualization|2|2x Intel Xeon E5-2695v3, 2.3GHz|28|512GB|NVIDIA QUADRO K5000, 4GB RAM|
  Hypercube dimension&  |Hypercube|dimension| 
  --------------------- -------------------------------------------&  |---|---|
  1D                    ehc_1d&  |1D|ehc_1d|
  2D                    ehc_2d&  |2D|ehc_2d|
  3D                    ehc_3d&  |3D|ehc_3d|
  4D                    ehc_4d&  |4D|ehc_4d|
  5D                    ehc_5d&  |5D|ehc_5d|
  6D                    ehc_6d&  |6D|ehc_6d|
  7D                    ehc_7d&  |7D|ehc_7d|
  Node type                              Count   Short name         Long name                  Rack&  |Node type|Count|Short name|Long name|Rack|
  -------------------------------------- ------- ------------------ -------------------------- -------&  |---|---|
  M-Cell compute nodes w/o accelerator   576     cns1 -cns576       r1i0n0 - r4i7n17           1-4&  |M-Cell compute nodes w/o accelerator|576|cns1 -cns576|r1i0n0 - r4i7n17|1-4|
  compute nodes MIC accelerated          432     cns577 - cns1008   r21u01n577 - r37u31n1008   21-38&  |compute nodes MIC accelerated|432|cns577 - cns1008|r21u01n577 - r37u31n1008|21-38|
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------&
  Mountpoint                                     Usage                            Protocol      Net Capacity   Throughput   Limitations   Access                    Services&  |Mountpoint|Usage|Protocol|Net|Capacity|Throughput|Limitations|Access|
  ---------------------------------------------- -------------------------------- ------------- -------------- ------------ ------------- ------------------------- -----------------------------&  |---|---|
   /home           home directory                   NFS, 2-Tier   0.5 PB         6 GB/s       Quota 250GB   Compute and login nodes   backed up&| /home|home directory|NFS, 2-Tier|0.5 PB|6 GB/s|Quota 250GB|Compute and login nodes|backed up|
   /scratch/work   large project files              Lustre        1.69 PB        30 GB/s      Quota        Compute and login nodes   none&  |/scratch/work|large project files|Lustre|1.69 PB|30 GB/s|Quota|Compute and login nodes|none|
                                                                                                                          1TB&                                     
   /scratch/temp   job temporary data               Lustre        1.69 PB        30 GB/s      Quota 100TB   Compute and login nodes   files older 90 days removed&  |/scratch/temp|job temporary data|Lustre|1.69 PB|30 GB/s|Quota 100TB|Compute and login nodes|files older 90 days removed|
   /ramdisk        job temporary data, node local   local         120GB          90 GB/s      none          Compute nodes             purged after job ends&  |/ramdisk|job temporary data, node local|local|120GB|90 GB/s|none|Compute nodes|purged after job ends|
  -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------&
  Application   Version        module&  |Application|Version|module|
  ------------- -------------- ---------------------&  |---|---|
  **R**         R 3.1.1        R/3.1.1-intel-2015b&  |**R**|R 3.1.1|R/3.1.1-intel-2015b|
  **Rstudio**   Rstudio 0.97   Rstudio&   |**Rstudio**|Rstudio 0.97|Rstudio|
  24 MPI**&**24 MPI**
  --------------- -----------------------&  |**Version**|**Module**|
**Version**     **Module**&  |---|---|
  2016 Update 2   Advisor/2016_update2&  |2016 Update 2|Advisor/2016_update2|
  2016 Update 1   Inspector/2016_update1&  |2016 Update 1|Inspector/2016_update1|
  Interface   Integer type&  |Interface|Integer type|
  ----------- -----------------------------------------------&  |---|---|
  LP64        32-bit, int, integer(kind=4), MPI_INT&  |LP64|32-bit, int, integer(kind=4), MPI_INT|
  ILP64       64-bit, long int, integer(kind=8), MPI_INT64 &  |ILP64|64-bit, long int, integer(kind=8), MPI_INT64|
  Parameter                                         Value&  |Parameter|Value|
  ------------------------------------------------- -----------------------------&  |---|---|
  >max number of atoms                  200&  |max number of atoms|200|
  >max number of valence orbitals       300&  |max number of valence orbitals|300|
  >max number of basis functions        4095&  |max number of basis functions|4095|
  >max number of states per symmmetry   20&  |max number of states per symmmetry|20|
  >max number of state symmetries       16&  |max number of state symmetries|16|
  >max number of records                200&  |max number of records|200|
  >max number of primitives             >maxbfn x [2]&  |max number of primitives|maxbfn x [2]|
  Address                                            Port                               Protocol&  |Address|Port|Protocol|
  -------------------------------------------------- ---------------------------------- -----------------------------------------&  |---|---|
  anselm.it4i.cz                                     22                                 scp, sftp&  |anselm.it4i.cz|22|scp, sftp|
  login1.anselm.it4i.cz                              22                                 scp, sftp&  |login1.anselm.it4i.cz|22|scp, sftp|
  login2.anselm.it4i.cz                              22                                 scp, sftp&  |login2.anselm.it4i.cz|22|scp, sftp|
   class="discreet">dm1.anselm.it4i.cz   22    class="discreet">scp, sftp</span>&  |dm1.anselm.it4i.cz|22|scp, sftp|
  Login address           Port   Protocol   Login node&  |Login address|Port|Protocol|Login node|
  ----------------------- ------ ---------- ----------------------------------------------&  |---|----|
  anselm.it4i.cz          22     ssh        round-robin DNS record for login1 and login2&  |anselm.it4i.cz|22|ssh|round-robin DNS record for login1 and login2|
  login1.anselm.it4i.cz   22     ssh        login1&  |login1.anselm.it4i.cz|22|ssh|login1|
  login2.anselm.it4i.cz   22     ssh        login2&  |login2.anselm.it4i.cz|22|ssh|login2|