Skip to content
Snippets Groups Projects
Commit 73eb1f84 authored by Jan Siwiec's avatar Jan Siwiec
Browse files

Update project-storage.md

parent 5e52c24b
No related branches found
No related tags found
1 merge request!297Project storage doc
...@@ -7,52 +7,85 @@ The storage can also be used for computing jobs with low I/O demands or big data ...@@ -7,52 +7,85 @@ The storage can also be used for computing jobs with low I/O demands or big data
## Technical Overview ## Technical Overview
PROJECT consists of three identical interconnected file storage servers (PROJ1-3) PROJECT consists of three identical interconnected file storage servers (PROJ1-3)
with HA NFS access and the total capacity of 15PB (3x5PB). with HA NFS over GPFS access and the total capacity of 15PB.
**screenshot from DTS (draw.io?)** **screenshot from DTS (draw.io?)**
| Specification | | | Specification | Total | Per Block |
| ----------------- | -------------------------------------------------- | | ----------------- | ---------------------------------------- |
| Protocol | NFS over GPFS | | Protocol | NFS over GPFS |
| Total capacity | 15PB | | Total capacity | 15PB | 5PB |
| Throughput | 12 GB/s (3x4)| | Throughput | 12 GB/s (3x4) | 4GB/s |
| IO Performance || | IO Performance |?|?|
## Accessing PROJECT ## Accessing PROJECT
usage per project, life cycle of the users' folder: Data stored on the PROJECT storage is bound to a project.
Once the project ends, new data related to this project cannot be written on the PROJECT storage.
However, the data can be migrated to another active project's directory.
Each block of the PROJECT File storage is an independent fileset which allows copying or moving files.
data is bound to project, project disabled = data cannot be written = deleted (details TBD) !!!note
data can be trasferred to another (active) project (folder) Note that 'mv' between independent filesystems is not an atomic operations.
HOWTO:
independent filesets = copy or move allowed
### POSIX File Access ### POSIX File Access
Mountpoint - /mnt/proj1...3 PROJECT ins an external filesystem accessible from mountpoint `/mnt/proj1` to `proj3`.
PROJECT can be accessed via the following nodes:
| Cluster | Node(s) |
| ------------- | ----------------------------- |
| Salomon | Login |
| Barbora | Login, Compute, Vizualization |
| DGX2 | Compute |
accessibility: To show path to a directory on the PROJECT storage, use the `it4i-get-project-dir` command:
salomon: login
barbora: login, cn and viz
(karolina: login, cn, and viz dgx2: cn)
**script example?** ```console
$ it4i-get-project-dir OPEN-XX-XX
$ /mnt/proj3/OPEN-XX-XX
```
### User Quotas ### User Quotas
monitoring for users (location of project, disk usage) The PROJECT storage follows general user quotas for capacity and inodes per project set by IT4Innovations.
quota for capacity and inodes per project monitoring for users (location of project, disk usage?)
ask IT4I for more storage capacity
If your project requires more storage capacity,
request additional storage space allocation in you application for computational resources (this is the preffered option).
Alternativly, if the project is already active, contact [IT4I Support][a].
preferred: ask before starting the project
alternative when project is already active: ask support ### Snapshot Functionality Description
user/project quota Snapshots are created for all projects on fileset-level by running a cron script on GPFS servers.
Snapshot is created every day and snaphots older thain seven days are deleted.
snapshot functionality description Snapshot Format:
see info in chat
```console
/gpfs
|
- exports
|
- DD-XX-XX
|
- .snapshots
|
- YYYY-MM-DD-hhmmss
- YYYY-MM-DD-hhmmss
- OPEN-XX-XX
|
- .snapshots
|
- YYYY-MM-DD-hhmmss
- YYYY-MM-DD-hhmmss
```
### ACL and Linux Rights ### ACL and Linux Rights
nfs4 acl nfs4 acl
...@@ -75,8 +108,11 @@ project is acessible from CN (performance is limited) continuous usage = negati ...@@ -75,8 +108,11 @@ project is acessible from CN (performance is limited) continuous usage = negati
## Technical Specification ## Technical Specification
(detailed - separate .md file) For a detailed technical specification, see the Technical Specification secion.
## Summary ## Summary
barbora table format barbora table format
[a]: mailto:support@it4i.cz
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment