Skip to content
Snippets Groups Projects
Commit ef78db3a authored by Pavel Gajdušek's avatar Pavel Gajdušek
Browse files

machine learning structure

parent 7bcfd1d8
No related branches found
No related tags found
6 merge requests!368Update prace.md to document the change from qprace to qprod as the default...,!367Update prace.md to document the change from qprace to qprod as the default...,!366Update prace.md to document the change from qprace to qprod as the default...,!323extended-acls-storage-section,!196Master,!161Gajdusek cleaning
# Resource Allocation and Job Execution # Resource Allocation and Job Execution
To run a [job](ob-submission-and-execution/), [computational resources](resources-allocation-policy/) for this particular job must be allocated. This is done via the PBS Pro job workload manager software, which efficiently distributes workloads across the supercomputer. Extensive information about PBS Pro can be found in the [official documentation here](../pbspro/), especially in the PBS Pro User's Guide. To run a [job](job-submission-and-execution/), [computational resources](resources-allocation-policy/) for this particular job must be allocated. This is done via the PBS Pro job workload manager software, which efficiently distributes workloads across the supercomputer. Extensive information about PBS Pro can be found in the [official documentation here](../pbspro/), especially in the PBS Pro User's Guide.
## Resources Allocation Policy ## Resources Allocation Policy
......
...@@ -264,7 +264,7 @@ The ped file ( file.ped) contains the following info: ...@@ -264,7 +264,7 @@ The ped file ( file.ped) contains the following info:
FAM sample_B 0 0 2 2 FAM sample_B 0 0 2 2
``` ```
Now, lets load the NGSPipeline module and copy the sample data to a [scratch directory](../../storage/storage/): Now, lets load the NGSPipeline module and copy the sample data to a [scratch directory](../../storage/):
```console ```console
$ ml ngsPipeline $ ml ngsPipeline
......
# Machine Learning
This section overviews machine learning frameworks and libraries available the clusters.
## TensorFlow
Load TensorFlow module:
```console
$ ml Tensorflow
```
Test module:
```console
$ ml Tensorflow
```
Read more about available versions at the [TensorFlow page](tensorflow).
# TensorFlow
TensorFlow is an open-source software library for machine intelligence.
For searching available modules type:
```console
$ ml av Tensorflow
```
## Anselm modules
Anselm provides beside others these three different TensorFlow modules:
* Tensorflow/1.1.0 (CPU only, not recommended), module built with:
* GCC/4.9.3
* Python/3.6.1
* Tensorflow/1.1.0-CUDA-7.5.18-Python-3.6.1 (GPU enabled), module built with:
* GCC/4.9.3
* Python/3.6.1
* CUDA/7.5.18
* cuDNN/5.1-CUDA-7.5.18
* Tensorflow/1.1.0-CUDA-8.0.44-Python-3.6.1 (GPU enabled), module built with:
* GCC/4.9.3
* Python/3.6.1
* CUDA/8.0.44
* cuDNN/5.1-CUDA-8.0.44
## Salomon modules
Salomon provides beside others these three different TensorFlow modules:
* Tensorflow/1.1.0 (not recommended), module built with:
* GCC/4.9.3
* Python/3.6.1
* Tensorflow/1.2.0-GCC-7.1.0-2.28 (default, recommended), module built with:
* TensorFlow 1.2 with SIMD support. TensorFlow build taking advantage of the Salomon CPU architecture.
* GCC/7.1.0-2.28
* Python/3.6.1
* protobuf/3.2.0-GCC-7.1.0-2.28-Python-3.6.1
* Tensorflow/1.2.0-intel-2017.05-mkl (TensorFlow 1.2 with MKL support), module built with:
* icc/2017.4.196-GCC-7.1.0-2.28
* Python/3.6.1
* protobuf/3.2.0-GCC-7.1.0-2.28-Python-3.6.1
## TensorFlow application example
After loading one of the available TensorFlow modules, you can check the functionality running the following python script.
```python
import tensorflow as tf
c = tf.constant('Hello World!')
sess = tf.Session()
print(sess.run(c))
```
...@@ -82,6 +82,9 @@ pages: ...@@ -82,6 +82,9 @@ pages:
- Java: software/java.md - Java: software/java.md
- Lmod Environment: software/lmod.md - Lmod Environment: software/lmod.md
- Modules Matrix: modules-matrix.md - Modules Matrix: modules-matrix.md
- 'Machine larning':
- Introduction: software/machine-learning/introduction.md
- TensorFlow: software/machine-learning/tensorflow.md
- 'Numerical languages': - 'Numerical languages':
- Introduction: software/numerical-languages/introduction.md - Introduction: software/numerical-languages/introduction.md
- R: software/numerical-languages/r.md - R: software/numerical-languages/r.md
......
...@@ -24,3 +24,7 @@ docs.it4i/salomon/software/numerical-languages/r.md ...@@ -24,3 +24,7 @@ docs.it4i/salomon/software/numerical-languages/r.md
./docs.it4i/salomon/software/ansys/licensing.md ./docs.it4i/salomon/software/ansys/licensing.md
./docs.it4i/salomon/software/ansys/setting-license-preferences.md ./docs.it4i/salomon/software/ansys/setting-license-preferences.md
./docs.it4i/salomon/software/ansys/workbench.md ./docs.it4i/salomon/software/ansys/workbench.md
./docs.it4i/anselm/software/machine-learning/introduction.md
./docs.it4i/anselm/software/machine-learning/tensorflow.md
./docs.it4i/salomon/software/machine-learning/introduction.md
./docs.it4i/salomon/software/machine-learning/tensorflow.md
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment