Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
docs.it4i.cz
Manage
Activity
Members
Labels
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Container registry
Model registry
Operate
Environments
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
SCS
docs.it4i.cz
Commits
73eb1f84
Commit
73eb1f84
authored
4 years ago
by
Jan Siwiec
Browse files
Options
Downloads
Patches
Plain Diff
Update project-storage.md
parent
5e52c24b
No related branches found
No related tags found
1 merge request
!297
Project storage doc
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
docs.it4i/storage/project-storage.md
+64
-28
64 additions, 28 deletions
docs.it4i/storage/project-storage.md
with
64 additions
and
28 deletions
docs.it4i/storage/project-storage.md
+
64
−
28
View file @
73eb1f84
...
...
@@ -7,52 +7,85 @@ The storage can also be used for computing jobs with low I/O demands or big data
## Technical Overview
PROJECT consists of three identical interconnected file storage servers (PROJ1-3)
with HA NFS access and the total capacity of 15PB
(3x5PB)
.
with HA NFS
over GPFS
access and the total capacity of 15PB.
**screenshot from DTS (draw.io?)**
| Specification |
|
| ----------------- | ----------------------------------------
----------
|
| Protocol | NFS over GPFS
|
| Total capacity | 15PB
|
| Throughput | 12 GB/s (3x4)
|
| IO Performance ||
| Specification |
Total
| Per Block
|
| ----------------- | ---------------------------------------- |
| Protocol | NFS over GPFS |
| Total capacity | 15PB
| 5PB
|
| Throughput | 12 GB/s (3x4)
| 4GB/s |
| IO Performance |
?|?
|
## Accessing PROJECT
usage per project, life cycle of the users' folder:
Data stored on the PROJECT storage is bound to a project.
Once the project ends, new data related to this project cannot be written on the PROJECT storage.
However, the data can be migrated to another active project's directory.
Each block of the PROJECT File storage is an independent fileset which allows copying or moving files.
data is bound to project, project disabled = data cannot be written = deleted (details TBD)
data can be trasferred to another (active) project (folder)
HOWTO:
independent filesets = copy or move allowed
!!!note
Note that 'mv' between independent filesystems is not an atomic operations.
### POSIX File Access
Mountpoint - /mnt/proj1...3
PROJECT ins an external filesystem accessible from mountpoint
`/mnt/proj1`
to
`proj3`
.
PROJECT can be accessed via the following nodes:
| Cluster | Node(s) |
| ------------- | ----------------------------- |
| Salomon | Login |
| Barbora | Login, Compute, Vizualization |
| DGX2 | Compute |
accessibility:
salomon: login
barbora: login, cn and viz
(karolina: login, cn, and viz dgx2: cn)
To show path to a directory on the PROJECT storage, use the
`it4i-get-project-dir`
command:
**script example?**
```
console
$
it4i-get-project-dir OPEN-XX-XX
$
/mnt/proj3/OPEN-XX-XX
```
### User Quotas
monitoring for users (location of project, disk usage)
quota for capacity and inodes per project
ask IT4I for more storage capacity
The PROJECT storage follows general user quotas for capacity and inodes per project set by IT4Innovations.
monitoring for users (location of project, disk usage?)
If your project requires more storage capacity,
request additional storage space allocation in you application for computational resources (this is the preffered option).
Alternativly, if the project is already active, contact
[
IT4I Support
][
a
]
.
preferred: ask before starting the project
alternative when project is already active: ask support
### Snapshot Functionality Description
user/project quota
Snapshots are created for all projects on fileset-level by running a cron script on GPFS servers.
Snapshot is created every day and snaphots older thain seven days are deleted.
snapshot functionality description
see info in chat
Snapshot Format:
```
console
/gpfs
|
- exports
|
- DD-XX-XX
|
- .snapshots
|
- YYYY-MM-DD-hhmmss
- YYYY-MM-DD-hhmmss
- OPEN-XX-XX
|
- .snapshots
|
- YYYY-MM-DD-hhmmss
- YYYY-MM-DD-hhmmss
```
### ACL and Linux Rights
nfs4 acl
...
...
@@ -75,8 +108,11 @@ project is acessible from CN (performance is limited) continuous usage = negati
## Technical Specification
(
detailed
- separate .md file)
For a
detailed
technical specification, see the Technical Specification secion.
## Summary
barbora table format
[
a
]:
mailto:support@it4i.cz
This diff is collapsed.
Click to expand it.
Jan Siwiec
@siw019
·
4 years ago
Author
Maintainer
related to #78
related to #78
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment