Commit 4574cc7f authored by Lukáš Krupčík's avatar Lukáš Krupčík
Browse files

version 1.3

parent a1d9b4cb
Pipeline #1073 failed with stage
in 11 seconds
......@@ -27,3 +27,10 @@ Konverze html do md
```bash
html_md.sh -c
```
Testování
```bash
html_md.sh -t
html_md.sh -t1
```
......@@ -3,7 +3,7 @@ Outgoing connections
Connection restrictions
-----------------------
......@@ -11,12 +11,12 @@ Connection restrictions
Outgoing connections, from Anselm Cluster login nodes to the outside
world, are restricted to following ports:
Port Protocol
------ ----------
22 ssh
80 http
443 https
9418 git
Port Protocol
------ ----------
22 ssh
80 http
443 https
9418 git
Please use **ssh port forwarding** and proxy servers to connect from
Anselm to all other remote ports.
......@@ -28,7 +28,7 @@ outside world are cut.
Port forwarding
---------------
### []()Port forwarding from login nodes
### Port forwarding from login nodes
Port forwarding allows an application running on Anselm to connect to
arbitrary remote host and port.
......@@ -39,7 +39,7 @@ workstation and forwarding from the workstation to the remote host.
Pick some unused port on Anselm login node  (for example 6000) and
establish the port forwarding:
```
```
local $ ssh -R 6000:remote.host.com:1234 anselm.it4i.cz
```
......@@ -57,13 +57,13 @@ remote.host.com:1234. Click Add button, then Open.
Port forwarding may be established directly to the remote host. However,
this requires that user has ssh access to remote.host.com
```
```
$ ssh -L 6000:localhost:1234 remote.host.com
```
Note: Port number 6000 is chosen as an example only. Pick any free port.
### []()Port forwarding from compute nodes
### Port forwarding from compute nodes
Remote port forwarding from compute nodes allows applications running on
the compute nodes to access hosts outside Anselm Cluster.
......@@ -75,7 +75,7 @@ above](outgoing-connections.html#port-forwarding-from-login-nodes).
Second, invoke port forwarding from the compute node to the login node.
Insert following line into your jobscript or interactive shell
```
```
$ ssh  -TN -f -L 6000:localhost:6000 login1
```
......@@ -98,7 +98,7 @@ SOCKS proxy server software. On Linux, sshd demon provides the
functionality. To establish SOCKS proxy server listening on port 1080
run:
```
```
local $ ssh -D 1080 localhost
```
......@@ -109,7 +109,7 @@ Once the proxy server is running, establish ssh port forwarding from
Anselm to the proxy server, port 1080, exactly as [described
above](outgoing-connections.html#port-forwarding-from-login-nodes).
```
```
local $ ssh -R 6000:localhost:1080 anselm.it4i.cz
```
......
......@@ -3,7 +3,7 @@ Shell access and data transfer
Interactive Login
-----------------
......@@ -12,19 +12,19 @@ The Anselm cluster is accessed by SSH protocol via login nodes login1
and login2 at address anselm.it4i.cz. The login nodes may be addressed
specifically, by prepending the login node name to the address.
Login address Port Protocol Login node
----------------------- ------ ---------- ----------------------------------------------
anselm.it4i.cz 22 ssh round-robin DNS record for login1 and login2
login1.anselm.it4i.cz 22 ssh login1
login2.anselm.it4i.cz 22 ssh login2
Login address Port Protocol Login node
----------------------- ------ ---------- ----------------------------------------------
anselm.it4i.cz 22 ssh round-robin DNS record for login1 and login2
login1.anselm.it4i.cz 22 ssh login1
login2.anselm.it4i.cz 22 ssh login2
The authentication is by the [private
key](../../../get-started-with-it4innovations/accessing-the-clusters/shell-access-and-data-transfer/ssh-keys.html)
Please verify SSH fingerprints during the first logon. They are
identical on all login nodes:<span class="monospace">
identical on all login nodes:
29:b3:f4:64:b0:73:f5:6f:a7:85:0f:e0:0d:be:76:bf (DSA)
d4:6f:5c:18:f4:3f:70:ef:bc:fc:cc:2b:fd:13:36:b7 (RSA)</span>
d4:6f:5c:18:f4:3f:70:ef:bc:fc:cc:2b:fd:13:36:b7 (RSA)
 
......@@ -32,14 +32,14 @@ Private keys authentication:
On **Linux** or **Mac**, use
```
```
local $ ssh -i /path/to/id_rsa username@anselm.it4i.cz
```
If you see warning message "UNPROTECTED PRIVATE KEY FILE!", use this
command to set lower permissions to private key file.
```
```
local $ chmod 600 /path/to/id_rsa
```
......@@ -48,19 +48,19 @@ client](../../../get-started-with-it4innovations/accessing-the-clusters/shell-ac
After logging in, you will see the command prompt:
_
/ | |
/ _ __ ___ ___| |_ __ ___
/ / | '_ / __|/ _ | '_ ` _
/ ____ | | | __ __/ | | | | | |
/_/ __| |_|___/___|_|_| |_| |_|
_
/ | |
/ _ __ ___ ___| |_ __ ___
/ / | '_ / __|/ _ | '_ ` _
/ ____ | | | __ __/ | | | | | |
/_/ __| |_|___/___|_|_| |_| |_|
                        http://www.it4i.cz/?lang=en
                        http://www.it4i.cz/?lang=en
Last login: Tue Jul 9 15:57:38 2013 from your-host.example.com
[username@login2.anselm ~]$
Last login: Tue Jul 9 15:57:38 2013 from your-host.example.com
[username@login2.anselm ~]$
The environment is **not** shared between login nodes, except for
[shared filesystems](../storage-1.html#section-1).
......@@ -70,16 +70,16 @@ Data Transfer
Data in and out of the system may be transferred by the
[scp](http://en.wikipedia.org/wiki/Secure_copy) and sftp
protocols. <span class="discreet">(Not available yet.) In case large
protocols.  class="discreet">(Not available yet.) In case large
volumes of data are transferred, use dedicated data mover node
dm1.anselm.it4i.cz for increased performance.</span>
dm1.anselm.it4i.cz for increased performance.
Address Port Protocol
-------------------------------------------------- ---------------------------------- -----------------------------------------
anselm.it4i.cz 22 scp, sftp
login1.anselm.it4i.cz 22 scp, sftp
login2.anselm.it4i.cz 22 scp, sftp
<span class="discreet">dm1.anselm.it4i.cz</span> <span class="discreet">22</span> <span class="discreet">scp, sftp</span>
Address Port Protocol
-------------------------------------------------- ---------------------------------- -----------------------------------------
anselm.it4i.cz 22 scp, sftp
login1.anselm.it4i.cz 22 scp, sftp
login2.anselm.it4i.cz 22 scp, sftp
class="discreet">dm1.anselm.it4i.cz class="discreet">22 <span class="discreet">scp, sftp</span>
 The authentication is by the [private
key](../../../get-started-with-it4innovations/accessing-the-clusters/shell-access-and-data-transfer/ssh-keys.html)
......@@ -97,17 +97,17 @@ network provider.
On linux or Mac, use scp or sftp client to transfer the data to Anselm:
```
```
local $ scp -i /path/to/id_rsa my-local-file username@anselm.it4i.cz:directory/file
```
```
```
local $ scp -i /path/to/id_rsa -r my-local-dir username@anselm.it4i.cz:directory
```
> or
```
```
local $ sftp -o IdentityFile=/path/to/id_rsa username@anselm.it4i.cz
```
......@@ -115,7 +115,7 @@ Very convenient way to transfer files in and out of the Anselm computer
is via the fuse filesystem
[sshfs](http://linux.die.net/man/1/sshfs)
```
```
local $ sshfs -o IdentityFile=/path/to/id_rsa username@anselm.it4i.cz:. mountpoint
```
......@@ -124,7 +124,7 @@ local computer, just like an external disk.
Learn more on ssh, scp and sshfs by reading the manpages
```
```
$ man ssh
$ man scp
$ man sshfs
......
......@@ -3,12 +3,12 @@ VPN Access
Accessing IT4Innovations internal resources via VPN
---------------------------------------------------
**Failed to initialize connection subsystem Win 8.1 - 02-10-15 MS
Failed to initialize connection subsystem Win 8.1 - 02-10-15 MS
patch**
Workaround can be found at
[https://docs.it4i.cz/vpn-connection-fail-in-win-8.1](../../vpn-connection-fail-in-win-8.1.html)
......@@ -20,16 +20,16 @@ local network, it is necessary to VPN connect to this network.
We use Cisco AnyConnect Secure Mobility Client, which is supported on
the following operating systems:
- <span>Windows XP</span>
- <span>Windows Vista</span>
- <span>Windows 7</span>
- <span>Windows 8</span>
- <span>Linux</span>
- <span>MacOS</span>
- >Windows XP
- >Windows Vista
- >Windows 7
- >Windows 8
- >Linux
- >MacOS
It is impossible to connect to VPN from other operating systems.
<span>VPN client installation</span>
>VPN client installation
------------------------------------
You can install VPN client from web interface after successful login
......
......@@ -3,7 +3,7 @@ Compute Nodes
Nodes Configuration
-------------------
......@@ -12,198 +12,198 @@ Anselm is cluster of x86-64 Intel based nodes built on Bull Extreme
Computing bullx technology. The cluster contains four types of compute
nodes.****
### **Compute Nodes Without Accelerator**
###Compute Nodes Without Accelerator**
- <div class="itemizedlist">
- <div class="itemizedlist">
180 nodes
180 nodes
- <div class="itemizedlist">
- <div class="itemizedlist">
2880 cores in total
2880 cores in total
- <div class="itemizedlist">
- <div class="itemizedlist">
two Intel Sandy Bridge E5-2665, 8-core, 2.4GHz processors per node
two Intel Sandy Bridge E5-2665, 8-core, 2.4GHz processors per node
- <div class="itemizedlist">
- <div class="itemizedlist">
64 GB of physical memory per node
64 GB of physical memory per node
- one 500GB SATA 2,5” 7,2 krpm HDD per node
- <div class="itemizedlist">
- one 500GB SATA 2,5” 7,2 krpm HDD per node
- <div class="itemizedlist">
bullx B510 blade servers
bullx B510 blade servers
- <div class="itemizedlist">
- <div class="itemizedlist">
cn[1-180]
cn[1-180]
### **Compute Nodes With GPU Accelerator**
###Compute Nodes With GPU Accelerator**
- <div class="itemizedlist">
- <div class="itemizedlist">
23 nodes
23 nodes
- <div class="itemizedlist">
- <div class="itemizedlist">
368 cores in total
368 cores in total
- <div class="itemizedlist">
- <div class="itemizedlist">
two Intel Sandy Bridge E5-2470, 8-core, 2.3GHz processors per node
two Intel Sandy Bridge E5-2470, 8-core, 2.3GHz processors per node
- <div class="itemizedlist">
- <div class="itemizedlist">
96 GB of physical memory per node
96 GB of physical memory per node
- one 500GB SATA 2,5” 7,2 krpm HDD per node
- <div class="itemizedlist">
- one 500GB SATA 2,5” 7,2 krpm HDD per node
- <div class="itemizedlist">
GPU accelerator 1x NVIDIA Tesla Kepler K20 per node
GPU accelerator 1x NVIDIA Tesla Kepler K20 per node
- <div class="itemizedlist">
- <div class="itemizedlist">
bullx B515 blade servers
bullx B515 blade servers
- <div class="itemizedlist">
- <div class="itemizedlist">
cn[181-203]
cn[181-203]
### **Compute Nodes With MIC Accelerator**
###Compute Nodes With MIC Accelerator**
- <div class="itemizedlist">
- <div class="itemizedlist">
4 nodes
4 nodes
- <div class="itemizedlist">
- <div class="itemizedlist">
64 cores in total
64 cores in total
- <div class="itemizedlist">
- <div class="itemizedlist">
two Intel Sandy Bridge E5-2470, 8-core, 2.3GHz processors per node
two Intel Sandy Bridge E5-2470, 8-core, 2.3GHz processors per node
- <div class="itemizedlist">
- <div class="itemizedlist">
96 GB of physical memory per node
96 GB of physical memory per node
- one 500GB SATA 2,5” 7,2 krpm HDD per node
- <div class="itemizedlist">
- one 500GB SATA 2,5” 7,2 krpm HDD per node
- <div class="itemizedlist">
MIC accelerator 1x Intel Phi 5110P per node
MIC accelerator 1x Intel Phi 5110P per node
- <div class="itemizedlist">
- <div class="itemizedlist">
bullx B515 blade servers
bullx B515 blade servers
- <div class="itemizedlist">
- <div class="itemizedlist">
cn[204-207]
cn[204-207]
### **Fat Compute Nodes**
###Fat Compute Nodes**
- <div>
- <div>
2 nodes
2 nodes
- <div>
- <div>
32 cores in total
32 cores in total
- <div>
- <div>
2 Intel Sandy Bridge E5-2665, 8-core, 2.4GHz processors per node
2 Intel Sandy Bridge E5-2665, 8-core, 2.4GHz processors per node
- <div>
- <div>
512 GB of physical memory per node
512 GB of physical memory per node
- two 300GB SAS 3,5”15krpm HDD (RAID1) per node
- <div>
- two 300GB SAS 3,5”15krpm HDD (RAID1) per node
- <div>
two 100GB SLC SSD per node
two 100GB SLC SSD per node
- <div>
- <div>
bullx R423-E3 servers
bullx R423-E3 servers
- <div>
- <div>
cn[208-209]
cn[208-209]
 
**![](bullxB510.png)**
![](bullxB510.png)**
****Figure Anselm bullx B510 servers****
**Figure Anselm bullx B510 servers****
### Compute Nodes Summary********
Node type Count Range Memory Cores [Access](resource-allocation-and-job-execution/resources-allocation-policy.html)
---------------------------- ------- --------------- -------- ------------- --------------------------------------------------------------------------------------------------
Nodes without accelerator 180 cn[1-180] 64GB 16 @ 2.4Ghz qexp, qprod, qlong, qfree
Nodes with GPU accelerator 23 cn[181-203] 96GB 16 @ 2.3Ghz qgpu, qprod
Nodes with MIC accelerator 4 cn[204-207] 96GB 16 @ 2.3GHz qmic, qprod
Fat compute nodes 2 cn[208-209] 512GB 16 @ 2.4GHz qfat, qprod
Node type Count Range Memory Cores [Access](resource-allocation-and-job-execution/resources-allocation-policy.html)
---------------------------- ------- --------------- -------- ------------- --------------------------------------------------------------------------------------------------
Nodes without accelerator 180 cn[1-180] 64GB 16 @ 2.4Ghz qexp, qprod, qlong, qfree
Nodes with GPU accelerator 23 cn[181-203] 96GB 16 @ 2.3Ghz qgpu, qprod
Nodes with MIC accelerator 4 cn[204-207] 96GB 16 @ 2.3GHz qmic, qprod
Fat compute nodes 2 cn[208-209] 512GB 16 @ 2.4GHz qfat, qprod
......@@ -218,34 +218,34 @@ with accelerator). Processors support Advanced Vector Extensions (AVX)
256-bit instruction set.
### Intel Sandy Bridge E5-2665 Processor
- eight-core
- speed: 2.4 GHz, up to 3.1 GHz using Turbo Boost Technology
- peak performance: <span class="emphasis">19.2 Gflop/s</span> per
core
- caches:
<div class="itemizedlist">
- eight-core
- speed: 2.4 GHz, up to 3.1 GHz using Turbo Boost Technology
- peak performance: class="emphasis">19.2 Gflop/s per
core
- caches:
<div class="itemizedlist">