diff --git a/docs.it4i/barbora/storage.md b/docs.it4i/barbora/storage.md index 2710856db4aa25c9a2eff3bfa71015da4fba8939..bd67f99648e4b76cb5f3e60aa3e7873f2b0c39a6 100644 --- a/docs.it4i/barbora/storage.md +++ b/docs.it4i/barbora/storage.md @@ -1,4 +1,4 @@ -# Storage +# Storage There are three main shared file systems on the Barbora cluster: [HOME][1], [SCRATCH][2], and [PROJECT][5]. All login and compute nodes may access same data on shared file systems. Compute nodes are also equipped with local (non-shared) scratch, RAM disk, and tmp file systems. @@ -10,11 +10,11 @@ Do not use shared filesystems as a backup for large amount of data or long-term Barbora computer provides three main shared filesystems, the [HOME filesystem][1], [SCRATCH filesystem][2], and the [PROJECT filesystems][5]. -All filesystems are accessible via the Infiniband network. +All filesystems are accessible via the Infiniband network. -The HOME and PROJECT filesystems are realized as NFS filesystem. +The HOME and PROJECT filesystems are realized as NFS filesystem. -The SCRATCH filesystem is realized as a parallel Lustre filesystem. +The SCRATCH filesystem is realized as a parallel Lustre filesystem. Extended ACLs are provided on both Lustre filesystems for sharing data with other users using fine-grained control @@ -77,12 +77,12 @@ Read more [here][c]. ### Lustre on Barbora -The architecture of Lustre on Barbora is composed of two metadata servers (MDS) and two data/object storage servers (OSS). +The architecture of Lustre on Barbora is composed of two metadata servers (MDS) and two data/object storage servers (OSS). Configuration of the SCRATCH storage * 2x Metadata server -* 2x Object storage server +* 2x Object storage server * Lustre object storage * One disk array NetApp E2800 * 54x 8TB 10kRPM 2,5” SAS HDD @@ -240,7 +240,7 @@ Each node is equipped with local /tmp directory of few GB capacity. The /tmp dir | Mountpoint | Usage | Protocol | Net Capacity | Throughput | Limitations | Access | Services | | ---------- | ------------------------- | -------- | -------------- | ------------------------------ | ----------- | ----------------------- | ------------------------------- | -| /home | home directory | NFS | 26 TiB | 1 GB/s | Quota 25GB | Compute and login nodes | backed up | +| /home | home directory | NFS | 26 TiB | 1 GB/s | Quota 25GB | Compute and login nodes |backed up | | /scratch | scratch temoporary | Lustre | 282 TiB | 5 GB/s, 30 GB/s burst buffer | Quota 9.3TB | Compute and login nodes | files older 90 days autoremoved | | /lscratch | local scratch ramdisk | tmpfs | 180 GB | 130 GB/s | none | Node local | auto purged after job end |