Skip to content
Snippets Groups Projects
Commit 73eb1f84 authored by Jan Siwiec's avatar Jan Siwiec
Browse files

Update project-storage.md

parent 5e52c24b
No related branches found
No related tags found
1 merge request!297Project storage doc
......@@ -7,52 +7,85 @@ The storage can also be used for computing jobs with low I/O demands or big data
## Technical Overview
PROJECT consists of three identical interconnected file storage servers (PROJ1-3)
with HA NFS access and the total capacity of 15PB (3x5PB).
with HA NFS over GPFS access and the total capacity of 15PB.
**screenshot from DTS (draw.io?)**
| Specification | |
| ----------------- | -------------------------------------------------- |
| Protocol | NFS over GPFS |
| Total capacity | 15PB |
| Throughput | 12 GB/s (3x4)|
| IO Performance ||
| Specification | Total | Per Block |
| ----------------- | ---------------------------------------- |
| Protocol | NFS over GPFS |
| Total capacity | 15PB | 5PB |
| Throughput | 12 GB/s (3x4) | 4GB/s |
| IO Performance |?|?|
## Accessing PROJECT
usage per project, life cycle of the users' folder:
Data stored on the PROJECT storage is bound to a project.
Once the project ends, new data related to this project cannot be written on the PROJECT storage.
However, the data can be migrated to another active project's directory.
Each block of the PROJECT File storage is an independent fileset which allows copying or moving files.
data is bound to project, project disabled = data cannot be written = deleted (details TBD)
data can be trasferred to another (active) project (folder)
HOWTO:
independent filesets = copy or move allowed
!!!note
Note that 'mv' between independent filesystems is not an atomic operations.
### POSIX File Access
Mountpoint - /mnt/proj1...3
PROJECT ins an external filesystem accessible from mountpoint `/mnt/proj1` to `proj3`.
PROJECT can be accessed via the following nodes:
| Cluster | Node(s) |
| ------------- | ----------------------------- |
| Salomon | Login |
| Barbora | Login, Compute, Vizualization |
| DGX2 | Compute |
accessibility:
salomon: login
barbora: login, cn and viz
(karolina: login, cn, and viz dgx2: cn)
To show path to a directory on the PROJECT storage, use the `it4i-get-project-dir` command:
**script example?**
```console
$ it4i-get-project-dir OPEN-XX-XX
$ /mnt/proj3/OPEN-XX-XX
```
### User Quotas
monitoring for users (location of project, disk usage)
quota for capacity and inodes per project
ask IT4I for more storage capacity
The PROJECT storage follows general user quotas for capacity and inodes per project set by IT4Innovations.
monitoring for users (location of project, disk usage?)
If your project requires more storage capacity,
request additional storage space allocation in you application for computational resources (this is the preffered option).
Alternativly, if the project is already active, contact [IT4I Support][a].
preferred: ask before starting the project
alternative when project is already active: ask support
### Snapshot Functionality Description
user/project quota
Snapshots are created for all projects on fileset-level by running a cron script on GPFS servers.
Snapshot is created every day and snaphots older thain seven days are deleted.
snapshot functionality description
see info in chat
Snapshot Format:
```console
/gpfs
|
- exports
|
- DD-XX-XX
|
- .snapshots
|
- YYYY-MM-DD-hhmmss
- YYYY-MM-DD-hhmmss
- OPEN-XX-XX
|
- .snapshots
|
- YYYY-MM-DD-hhmmss
- YYYY-MM-DD-hhmmss
```
### ACL and Linux Rights
nfs4 acl
......@@ -75,8 +108,11 @@ project is acessible from CN (performance is limited) continuous usage = negati
## Technical Specification
(detailed - separate .md file)
For a detailed technical specification, see the Technical Specification secion.
## Summary
barbora table format
[a]: mailto:support@it4i.cz
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment