Skip to content
Snippets Groups Projects
tabREPLACE 16.5 KiB
Newer Older
  • Learn to ignore specific revisions
  • Lukáš Krupčík's avatar
    Lukáš Krupčík committed
      compute nodes   number of workers   start-up time[s]&|compute nodes|number of workers|start-up time[s]|
      --------------- ------------------- --------------------&|---|---|---|
      16              384                 831&|16|384|831|
      8               192                 807&|8|192|807|
      4               96                  483&|4|96|483|
      2               48                  16&|2|48|16|
      Node type                    Count   Range           Memory   Cores         [Access](resource-allocation-and-job-execution/resources-allocation-policy.html)&|Node type|Count|Range|Memory|Cores|[Access](resource-allocation-and-job-execution/resources-allocation-policy.html)|
      ---------------------------- ------- --------------- -------- ------------- --------------------------------------------------------------------------------------------------&|---|---|---|---|---|---|
      Nodes without accelerator    180     cn[1-180]     64GB     16 @ 2.4Ghz   qexp, qprod, qlong, qfree&|Nodes without accelerator|180|cn[1-180]|64GB|16 @ 2.4Ghz|qexp, qprod, qlong, qfree|
      Nodes with GPU accelerator   23      cn[181-203]   96GB     16 @ 2.3Ghz   qgpu, qprod&|Nodes with GPU accelerator|23|cn[181-203]|96GB|16 @ 2.3Ghz|qgpu, qprod|
      Nodes with MIC accelerator   4       cn[204-207]   96GB     16 @ 2.3GHz   qmic, qprod&|Nodes with MIC accelerator|4|cn[204-207]|96GB|16 @ 2.3GHz|qmic, qprod|
      Fat compute nodes            2       cn[208-209]   512GB    16 @ 2.4GHz   qfat, qprod&|Fat compute nodes|2|cn[208-209]|512GB|16 @ 2.4GHz|qfat, qprod|
      Node               Processor                               Memory   Accelerator&|Node|Processor|Memory|Accelerator|
      ------------------ --------------------------------------- -------- ----------------------&|---|---|---|---|
      w/o accelerator    2x Intel Sandy Bridge E5-2665, 2.4GHz   64GB     -&|w/o accelerator|2x Intel Sandy Bridge E5-2665, 2.4GHz|64GB|-|
      GPU accelerated    2x Intel Sandy Bridge E5-2470, 2.3GHz   96GB     NVIDIA Kepler K20&|GPU accelerated|2x Intel Sandy Bridge E5-2470, 2.3GHz|96GB|NVIDIA Kepler K20|
      MIC accelerated    2x Intel Sandy Bridge E5-2470, 2.3GHz   96GB     Intel Xeon Phi P5110&|MIC accelerated|2x Intel Sandy Bridge E5-2470, 2.3GHz|96GB|Intel Xeon Phi P5110|
      Fat compute node   2x Intel Sandy Bridge E5-2665, 2.4GHz   512GB    -&|Fat compute node|2x Intel Sandy Bridge E5-2665, 2.4GHz|512GB|-|
      Login address            Port   Protocol   Login node&|Login address|Port|Protocol|Login node|
      ------------------------ ------ ---------- -----------------------------------------&|---|---|---|---|
      salomon.it4i.cz          22     ssh        round-robin DNS record for login[1-4]&|salomon.it4i.cz|22|ssh|round-robin DNS record for login[1-4]|
      login1.salomon.it4i.cz   22     ssh        login1&|login1.salomon.it4i.cz|22|ssh|login1|
      login2.salomon.it4i.cz   22     ssh        login2&|login1.salomon.it4i.cz|22|ssh|login1|
      login3.salomon.it4i.cz   22     ssh        login3&|login1.salomon.it4i.cz|22|ssh|login1|
      login4.salomon.it4i.cz   22     ssh        login4&|login1.salomon.it4i.cz|22|ssh|login1|
      Toolchain            Module(s)&|Toolchain|Module(s)|
      -------------------- ------------------------------------------------&|---|----|
      GCC                  GCC&|GCC|GCC|
      ictce                icc, ifort, imkl, impi&|ictce|icc, ifort, imkl, impi|
      intel                GCC, icc, ifort, imkl, impi&|intel|GCC, icc, ifort, imkl, impi|
      gompi                GCC, OpenMPI&|gompi|GCC, OpenMPI|
      goolf                BLACS, FFTW, GCC, OpenBLAS, OpenMPI, ScaLAPACK&|goolf|BLACS, FFTW, GCC, OpenBLAS, OpenMPI, ScaLAPACK|
      >iompi   OpenMPI, icc, ifort&|iompi|OpenMPI, icc, ifort|
      iccifort             icc, ifort&|iccifort|icc, ifort|
    
    Lukáš Krupčík's avatar
    Lukáš Krupčík committed
      Login address                  Port   Protocol   Login node&  |Login address|Port|Protocol|Login node|
      ------------------------------ ------ ---------- ----------------------------------&  |---|---|
      salomon-prace.it4i.cz          2222   gsissh     login1, login2, login3 or login4&  |salomon-prace.it4i.cz|2222|gsissh|login1, login2, login3 or login4|
      login1-prace.salomon.it4i.cz   2222   gsissh     login1&  |login1-prace.salomon.it4i.cz|2222|gsissh|login1|
      login2-prace.salomon.it4i.cz   2222   gsissh     login2&  |login2-prace.salomon.it4i.cz|2222|gsissh|login2|
      login3-prace.salomon.it4i.cz   2222   gsissh     login3&  |login3-prace.salomon.it4i.cz|2222|gsissh|login3|
      login4-prace.salomon.it4i.cz   2222   gsissh     login4&  |login4-prace.salomon.it4i.cz|2222|gsissh|login4|
      |Login address|Port|Protocol|Login node|&  |Login address|Port|Protocol|Login node|
      ------------------------ ------ ---------- ----------------------------------&  |---|---|
      salomon.it4i.cz          2222   gsissh     login1, login2, login3 or login4&  |salomon.it4i.cz|2222|gsissh|login1, login2, login3 or login4|
      login1.salomon.it4i.cz   2222   gsissh     login1&  |login1.salomon.it4i.cz|2222|gsissh|login1|
      login2.salomon.it4i.cz   2222   gsissh     login2&  |login2-prace.salomon.it4i.cz|2222|gsissh|login2|
      login3.salomon.it4i.cz   2222   gsissh     login3&  |login3-prace.salomon.it4i.cz|2222|gsissh|login3|
      login4.salomon.it4i.cz   2222   gsissh     login4&  |login4-prace.salomon.it4i.cz|2222|gsissh|login4|
      Login address                   Port   Node role&  |Login address|Port|Node role|
      ------------------------------- ------ -----------------------------&  |---|---|
      gridftp-prace.salomon.it4i.cz   2812   Front end /control server&  |gridftp-prace.salomon.it4i.cz|2812|Front end /control server|
      lgw1-prace.salomon.it4i.cz      2813   Backend / data mover server&  |lgw1-prace.salomon.it4i.cz|2813|Backend / data mover server|
      lgw2-prace.salomon.it4i.cz      2813   Backend / data mover server&  |lgw2-prace.salomon.it4i.cz|2813|Backend / data mover server|
      lgw3-prace.salomon.it4i.cz      2813   Backend / data mover server&  |lgw3-prace.salomon.it4i.cz|2813|Backend / data mover server|
      Login address             Port   Node role&  |Login address|Port|Node role|
      ------------------------- ------ -----------------------------&  |---|---|
      gridftp.salomon.it4i.cz   2812   Front end /control server&  |gridftp.salomon.it4i.cz|2812|Front end /control server|
      lgw1.salomon.it4i.cz      2813   Backend / data mover server&  |lgw1.salomon.it4i.cz|2813|Backend / data mover server|
      lgw2.salomon.it4i.cz      2813   Backend / data mover server&  |lgw2.salomon.it4i.cz|2813|Backend / data mover server|
      lgw3.salomon.it4i.cz      2813   Backend / data mover server&  |lgw3.salomon.it4i.cz|2813|Backend / data mover server|
      File system mount point   Filesystem   Comment&  |File system mount point|Filesystem|Comment|
      ------------------------- ------------ ----------------------------------------------------------------&  |---|---|
      /home                     Lustre       Default HOME directories of users in format /home/prace/login/&  |/home|Lustre|Default HOME directories of users in format /home/prace/login/|
      /scratch                  Lustre       Shared SCRATCH mounted on the whole cluster&  |/scratch|Lustre|Shared SCRATCH mounted on the whole cluster|
      Data type                      Default path&  |Data type|Default path|
      ------------------------------ ---------------------------------&  |---|---|
      large project files            /scratch/work/user/prace/login/&  |large project files|/scratch/work/user/prace/login/|
      large scratch/temporary data   /scratch/temp/&  |large scratch/temporary data|/scratch/temp/|
      ---------------------------------------------------------------------------------------------------------------------------------------------&
      queue                 Active project   Project resources   Nodes                                     priority   authorization   walltime&|queue|Active project|Project resources|Nodes|priority|authorization|walltime default/max|
                                                                                                                                      default/max&
      --------------------- -|---|---|---|--------------------- ---------- --------------- -------------&|---|---|
      **qexp**             no               none required       32 nodes, max 8 per user                  150        no              1 / 1h& |**qexp** Express queue|no|none required|32 nodes, max 8 per user|150|no|1 / 1h|
      Express queue&\\                                                                                                                   
      **qprace**           yes             > 0              >1006 nodes, max 86 per job   0          no              24 / 48h&|**qprace** Production queue|yes|> 0|1006 nodes, max 86 per job|0|no|24 / 48h|
      Production queue&\\                                                                                                                                                                                                                                              
      **qfree**            yes              none required       752 nodes, max 86 per job                 -1024      no              12 / 12h&|**qfree** Free resource queue|yes|none required|752 nodes, max 86 per job|-1024|no|12 / 12h|
      Free resource queue&\\                                                                                                             
      ---------------------------------------------------------------------------------------------------------------------------------------------&
      Port   Protocol&  |Port|Protocol|
      ------ ----------&  |---|---|
      22     ssh&  |22|ssh|
      80     http&  |80|http|
      443    https&  |443|https|
      9418   git&  |9418|git|
      Node              Count   Processor                          Cores   Memory   Accelerator&  |Node|Count|Processor|Cores|Memory|Accelerator|
      ----------------- ------- ---------------------------------- ------- -------- --------------------------------------------&  |---|---|
      w/o accelerator   576     2x Intel Xeon E5-2680v3, 2.5GHz    24      128GB    -&  |w/o accelerator|576|2x Intel Xeon E5-2680v3, 2.5GHz|24|128GB|-|
      MIC accelerated   432     2x Intel Xeon E5-2680v3, 2.5GHz    24      128GB    2x Intel Xeon Phi 7120P, 61cores, 16GB RAM&  |MIC accelerated|432|2x Intel Xeon E5-2680v3, 2.5GHz|24|128GB|2x Intel Xeon Phi 7120P, 61cores, 16GB RAM|
      Node            Count   Processor                         Cores   Memory   GPU Accelerator&  |Node|Count|Processor|Cores|Memory|GPU Accelerator|
      --------------- ------- --------------------------------- ------- -------- ------------------------------&  |---|---|
      visualization   2       2x Intel Xeon E5-2695v3, 2.3GHz   28      512GB    NVIDIA QUADRO K5000, 4GB RAM&  |visualization|2|2x Intel Xeon E5-2695v3, 2.3GHz|28|512GB|NVIDIA QUADRO K5000, 4GB RAM|
      Hypercube dimension&  |Hypercube|dimension| 
      --------------------- -------------------------------------------&  |---|---|
      1D                    ehc_1d&  |1D|ehc_1d|
      2D                    ehc_2d&  |2D|ehc_2d|
      3D                    ehc_3d&  |3D|ehc_3d|
      4D                    ehc_4d&  |4D|ehc_4d|
      5D                    ehc_5d&  |5D|ehc_5d|
      6D                    ehc_6d&  |6D|ehc_6d|
      7D                    ehc_7d&  |7D|ehc_7d|
      Node type                              Count   Short name         Long name                  Rack&  |Node type|Count|Short name|Long name|Rack|
      -------------------------------------- ------- ------------------ -------------------------- -------&  |---|---|
      M-Cell compute nodes w/o accelerator   576     cns1 -cns576       r1i0n0 - r4i7n17           1-4&  |M-Cell compute nodes w/o accelerator|576|cns1 -cns576|r1i0n0 - r4i7n17|1-4|
      compute nodes MIC accelerated          432     cns577 - cns1008   r21u01n577 - r37u31n1008   21-38&  |compute nodes MIC accelerated|432|cns577 - cns1008|r21u01n577 - r37u31n1008|21-38|
    -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------&
      Mountpoint                                     Usage                            Protocol      Net Capacity   Throughput   Limitations   Access                    Services&  |Mountpoint|Usage|Protocol|Net|Capacity|Throughput|Limitations|Access|
      ---------------------------------------------- -------------------------------- ------------- -------------- ------------ ------------- ------------------------- -----------------------------&  |---|---|
       /home           home directory                   NFS, 2-Tier   0.5 PB         6 GB/s       Quota 250GB   Compute and login nodes   backed up&| /home|home directory|NFS, 2-Tier|0.5 PB|6 GB/s|Quota 250GB|Compute and login nodes|backed up|
       /scratch/work   large project files              Lustre        1.69 PB        30 GB/s      Quota        Compute and login nodes   none&  |/scratch/work|large project files|Lustre|1.69 PB|30 GB/s|Quota|Compute and login nodes|none|
                                                                                                                              1TB&                                     
       /scratch/temp   job temporary data               Lustre        1.69 PB        30 GB/s      Quota 100TB   Compute and login nodes   files older 90 days removed&  |/scratch/temp|job temporary data|Lustre|1.69 PB|30 GB/s|Quota 100TB|Compute and login nodes|files older 90 days removed|
       /ramdisk        job temporary data, node local   local         120GB          90 GB/s      none          Compute nodes             purged after job ends&  |/ramdisk|job temporary data, node local|local|120GB|90 GB/s|none|Compute nodes|purged after job ends|
      -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------&
      Application   Version        module&  |Application|Version|module|
      ------------- -------------- ---------------------&  |---|---|
      **R**         R 3.1.1        R/3.1.1-intel-2015b&  |**R**|R 3.1.1|R/3.1.1-intel-2015b|
      **Rstudio**   Rstudio 0.97   Rstudio&   |**Rstudio**|Rstudio 0.97|Rstudio|
      24 MPI**&**24 MPI**
      --------------- -----------------------&  |**Version**|**Module**|
    **Version**     **Module**&  |---|---|
      2016 Update 2   Advisor/2016_update2&  |2016 Update 2|Advisor/2016_update2|
      2016 Update 1   Inspector/2016_update1&  |2016 Update 1|Inspector/2016_update1|
      Interface   Integer type&  |Interface|Integer type|
      ----------- -----------------------------------------------&  |---|---|
      LP64        32-bit, int, integer(kind=4), MPI_INT&  |LP64|32-bit, int, integer(kind=4), MPI_INT|
      ILP64       64-bit, long int, integer(kind=8), MPI_INT64 &  |ILP64|64-bit, long int, integer(kind=8), MPI_INT64|
      Parameter                                         Value&  |Parameter|Value|
      ------------------------------------------------- -----------------------------&  |---|---|
      >max number of atoms                  200&  |max number of atoms|200|
      >max number of valence orbitals       300&  |max number of valence orbitals|300|
      >max number of basis functions        4095&  |max number of basis functions|4095|
      >max number of states per symmmetry   20&  |max number of states per symmmetry|20|
      >max number of state symmetries       16&  |max number of state symmetries|16|
      >max number of records                200&  |max number of records|200|
      >max number of primitives             >maxbfn x [2]&  |max number of primitives|maxbfn x [2]|
      Address                                            Port                               Protocol&  |Address|Port|Protocol|
      -------------------------------------------------- ---------------------------------- -----------------------------------------&  |---|---|
      anselm.it4i.cz                                     22                                 scp, sftp&  |anselm.it4i.cz|22|scp, sftp|
      login1.anselm.it4i.cz                              22                                 scp, sftp&  |login1.anselm.it4i.cz|22|scp, sftp|
      login2.anselm.it4i.cz                              22                                 scp, sftp&  |login2.anselm.it4i.cz|22|scp, sftp|
       class="discreet">dm1.anselm.it4i.cz   22    class="discreet">scp, sftp</span>&  |dm1.anselm.it4i.cz|22|scp, sftp|
      Login address           Port   Protocol   Login node&  |Login address|Port|Protocol|Login node|
      ----------------------- ------ ---------- ----------------------------------------------&  |---|----|
      anselm.it4i.cz          22     ssh        round-robin DNS record for login1 and login2&  |anselm.it4i.cz|22|ssh|round-robin DNS record for login1 and login2|
      login1.anselm.it4i.cz   22     ssh        login1&  |login1.anselm.it4i.cz|22|ssh|login1|
      login2.anselm.it4i.cz   22     ssh        login2&  |login2.anselm.it4i.cz|22|ssh|login2|