Skip to content
Snippets Groups Projects
Commit acb12ec6 authored by Jan Siwiec's avatar Jan Siwiec
Browse files

Project data migration

parent 128984ba
No related branches found
No related tags found
4 merge requests!368Update prace.md to document the change from qprace to qprod as the default...,!367Update prace.md to document the change from qprace to qprod as the default...,!366Update prace.md to document the change from qprace to qprod as the default...,!323extended-acls-storage-section
# PROJECT Storage Implementation
Installation of the PROJECT storage is available from 15.3.
The PROJECT data storage is a central storage for project's data on IT4Innovations clusters. It is accessible from all IT4Innovations clusters and allows to share data amongst clusters.
The PROJECT storage utilizes fully redundant design, redundant devices, highly available services, data redundancy, and snaphots.
Storage allocation and access to the storage are based on projects (i.e. computing resources allocations) and project membership.
A project directory (actually implemented as an independent fileset) is created for every project. Default limits (quotas), default file permissions, and ACLs are set. The project directory life cycle strictly follows the project's life cycle. The project directory is removed after the project's data expiration.
For more detailed information, see the [PROJECT Data Storage][a] section.
## Data Migration From Salomon to PROJECT
With the upcoming decomissioning of the Salomon supercomputer, the PROJECT storage has been used to store a copy of users data located in Salomons's `/scratch/work/project` directory. The initial data migration was an automatic process which ran from 9.1. to 14.3.2021, so it is important that you check and synchronize any remaining data on Salomon's `/scratch/work/project` that were created or modified **after 14.3.2021**, as later this year, both HOME and SCRATCH storages on Salomon will become **permanently inaccessible**.
!!!Rights and permissions
The data migration has kept intact all users and groups ownerships, permissions, ACLs, etc. on all files.
### PROJECT Storage Quotas
Default quotas for capacity and amount of inodes per project are:
| PROJECT default quota | |
| --------------------- | ------ |
| Space quota | 20TB |
| Inodes quota | 5 mil. |
#### Lifting Project Quotas
If you require additional storage space for migration of your data, contact [IT4I support][b].
### Salomon Data Backup
!!!important
No backup or data transfer is scheduled for Salomon's storages by IT4I. Make sure that **you save all the relevant data** to external resources or to PROJECT storage before **Wednesday 30.6.2021, 9:00**. After this date, all data will be **permanently lost**.
### Data Cleanup
The initial data migration ignored default PROJECT's quotas,
but we strongly recommend that you to delete old data from your PROJECT directory,
because if your PROJECT directory exceeds the default quota,
you won't be able to create new data until you free up some space or request addition space allocation.
[a]: ../storage/project-storage.md
[b]: mailto:support@it4i.cz
\ No newline at end of file
...@@ -69,6 +69,7 @@ nav: ...@@ -69,6 +69,7 @@ nav:
- PRACE User Support: prace.md - PRACE User Support: prace.md
- API Documentation: apiv1.md - API Documentation: apiv1.md
- Withdrawal from service: anselm-salomon-shutdown.md - Withdrawal from service: anselm-salomon-shutdown.md
- PROJECT Storage Implementation: project-data-migration.md
- Storage: - Storage:
- PROJECT: storage/project-storage.md - PROJECT: storage/project-storage.md
- Clusters: - Clusters:
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment