Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
docs.it4i.cz
Manage
Activity
Members
Labels
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Container Registry
Model registry
Operate
Environments
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
SCS
docs.it4i.cz
Commits
3caf3bb5
Commit
3caf3bb5
authored
3 years ago
by
Jan Siwiec
Browse files
Options
Downloads
Patches
Plain Diff
global ram disk deduplication
parent
fe8158f7
No related branches found
Branches containing commit
No related tags found
No related merge requests found
Pipeline
#20218
passed with warnings
3 years ago
Stage: test
Stage: build
Stage: deploy
Stage: after_test
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
docs.it4i/job-features.md
+48
-1
48 additions, 1 deletion
docs.it4i/job-features.md
with
48 additions
and
1 deletion
docs.it4i/job-features.md
+
48
−
1
View file @
3caf3bb5
...
...
@@ -18,12 +18,59 @@ $ qsub ... -l vtune=version_string
## Global RAM Disk
Create a global shared file system consisting of RAM disks of allocated nodes. File-system is mounted on /mnt/global_ramdisk.
The Global RAM disk deploys BeeGFS On Demand parallel filesystem,
using local (i.e. allocated nodes') RAM disks as a storage backend.
The Global RAM disk is mounted at
`/mnt/global_ramdisk`
.
```
console
$
qsub ...
-l
global_ramdisk
=
true
```

### Example
```
console
$
qsub
-q
qprod
-l
select
=
4,global_ramdisk
=
true
./jobscript
```
This command submits a 4-node job in the
`qprod`
queue;
once running, a 440GB RAM disk shared across the 4 nodes will be created.
The RAM disk will be accessible at
`/mnt/global_ramdisk`
and files written to this RAM disk will be visible on all 4 nodes.
The file system is private to a job and shared among the nodes,
created when the job starts and deleted at the job's end.
!!! note
The Global RAM disk will be deleted immediately after the calculation end.
Users should take care to save the output data from within the jobscript.
The files on the Global RAM disk will be equally striped across all the nodes, using 512k stripe size.
Check the Global RAM disk status:
```
console
$
beegfs-df
-p
/mnt/global_ramdisk
$
beegfs-ctl
--mount
=
/mnt/global_ramdisk
--getentryinfo
/mnt/global_ramdisk
```
Use Global RAM disk in case you need very large RAM disk space.
The Global RAM disk allows for high performance sharing of data among compute nodes within a job.
!!! warning
Use of Global RAM disk file system is at the expense of operational memory.
| Global RAM disk | |
| ------------------ | --------------------------------------------------------------------------|
| Mountpoint | /mnt/global_ramdisk |
| Accesspoint | /mnt/global_ramdisk |
| Capacity | (N
*
110)GB |
| Throughput | 3
*
(N+1)GB/s, 2GB/s single POSIX thread |
| User quota | none |
N = number of compute nodes in the job.
!!! Warning
Available on Salomon and Barbora nodes only.
...
...
This diff is collapsed.
Click to expand it.
Jan Siwiec
@siw019
·
3 years ago
Author
Maintainer
relates to #96
relates to #96
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment