From ef78db3a733f5386518299a18ce7eb6ac382283e Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?Pavel=20Gajdu=C5=A1ek?= <gajdusek.pavel@gmail.com>
Date: Mon, 18 Sep 2017 10:32:00 +0200
Subject: [PATCH] machine learning structure
---
.../resource-allocation-and-job-execution.md | 2 +-
.../anselm/software/omics-master/overview.md | 2 +-
.../software/machine-learning/introduction.md | 19 +++++++
.../software/machine-learning/tensorflow.md | 56 +++++++++++++++++++
mkdocs.yml | 3 +
todelete | 4 ++
6 files changed, 84 insertions(+), 2 deletions(-)
create mode 100644 docs.it4i/software/machine-learning/introduction.md
create mode 100644 docs.it4i/software/machine-learning/tensorflow.md
diff --git a/docs.it4i/anselm/resource-allocation-and-job-execution.md b/docs.it4i/anselm/resource-allocation-and-job-execution.md
index 8df8072c9..4585588dd 100644
--- a/docs.it4i/anselm/resource-allocation-and-job-execution.md
+++ b/docs.it4i/anselm/resource-allocation-and-job-execution.md
@@ -1,6 +1,6 @@
# Resource Allocation and Job Execution
-To run a [job](ob-submission-and-execution/), [computational resources](resources-allocation-policy/) for this particular job must be allocated. This is done via the PBS Pro job workload manager software, which efficiently distributes workloads across the supercomputer. Extensive information about PBS Pro can be found in the [official documentation here](../pbspro/), especially in the PBS Pro User's Guide.
+To run a [job](job-submission-and-execution/), [computational resources](resources-allocation-policy/) for this particular job must be allocated. This is done via the PBS Pro job workload manager software, which efficiently distributes workloads across the supercomputer. Extensive information about PBS Pro can be found in the [official documentation here](../pbspro/), especially in the PBS Pro User's Guide.
## Resources Allocation Policy
diff --git a/docs.it4i/anselm/software/omics-master/overview.md b/docs.it4i/anselm/software/omics-master/overview.md
index d09a0030c..8038a2907 100644
--- a/docs.it4i/anselm/software/omics-master/overview.md
+++ b/docs.it4i/anselm/software/omics-master/overview.md
@@ -264,7 +264,7 @@ The ped file ( file.ped) contains the following info:
FAM sample_B 0 0 2 2
```
-Now, lets load the NGSPipeline module and copy the sample data to a [scratch directory](../../storage/storage/):
+Now, lets load the NGSPipeline module and copy the sample data to a [scratch directory](../../storage/):
```console
$ ml ngsPipeline
diff --git a/docs.it4i/software/machine-learning/introduction.md b/docs.it4i/software/machine-learning/introduction.md
new file mode 100644
index 000000000..d9ac00007
--- /dev/null
+++ b/docs.it4i/software/machine-learning/introduction.md
@@ -0,0 +1,19 @@
+# Machine Learning
+
+This section overviews machine learning frameworks and libraries available the clusters.
+
+## TensorFlow
+
+Load TensorFlow module:
+
+```console
+$ ml Tensorflow
+```
+
+Test module:
+
+```console
+$ ml Tensorflow
+```
+
+Read more about available versions at the [TensorFlow page](tensorflow).
diff --git a/docs.it4i/software/machine-learning/tensorflow.md b/docs.it4i/software/machine-learning/tensorflow.md
new file mode 100644
index 000000000..aa433e3e7
--- /dev/null
+++ b/docs.it4i/software/machine-learning/tensorflow.md
@@ -0,0 +1,56 @@
+# TensorFlow
+
+TensorFlow is an open-source software library for machine intelligence.
+For searching available modules type:
+
+```console
+$ ml av Tensorflow
+```
+
+## Anselm modules
+
+Anselm provides beside others these three different TensorFlow modules:
+
+* Tensorflow/1.1.0 (CPU only, not recommended), module built with:
+ * GCC/4.9.3
+ * Python/3.6.1
+* Tensorflow/1.1.0-CUDA-7.5.18-Python-3.6.1 (GPU enabled), module built with:
+ * GCC/4.9.3
+ * Python/3.6.1
+ * CUDA/7.5.18
+ * cuDNN/5.1-CUDA-7.5.18
+* Tensorflow/1.1.0-CUDA-8.0.44-Python-3.6.1 (GPU enabled), module built with:
+ * GCC/4.9.3
+ * Python/3.6.1
+ * CUDA/8.0.44
+ * cuDNN/5.1-CUDA-8.0.44
+
+## Salomon modules
+
+Salomon provides beside others these three different TensorFlow modules:
+
+* Tensorflow/1.1.0 (not recommended), module built with:
+ * GCC/4.9.3
+ * Python/3.6.1
+* Tensorflow/1.2.0-GCC-7.1.0-2.28 (default, recommended), module built with:
+ * TensorFlow 1.2 with SIMD support. TensorFlow build taking advantage of the Salomon CPU architecture.
+ * GCC/7.1.0-2.28
+ * Python/3.6.1
+ * protobuf/3.2.0-GCC-7.1.0-2.28-Python-3.6.1
+* Tensorflow/1.2.0-intel-2017.05-mkl (TensorFlow 1.2 with MKL support), module built with:
+ * icc/2017.4.196-GCC-7.1.0-2.28
+ * Python/3.6.1
+ * protobuf/3.2.0-GCC-7.1.0-2.28-Python-3.6.1
+
+
+## TensorFlow application example
+
+After loading one of the available TensorFlow modules, you can check the functionality running the following python script.
+
+```python
+import tensorflow as tf
+
+c = tf.constant('Hello World!')
+sess = tf.Session()
+print(sess.run(c))
+```
diff --git a/mkdocs.yml b/mkdocs.yml
index d69a57f28..f2532406f 100644
--- a/mkdocs.yml
+++ b/mkdocs.yml
@@ -82,6 +82,9 @@ pages:
- Java: software/java.md
- Lmod Environment: software/lmod.md
- Modules Matrix: modules-matrix.md
+ - 'Machine larning':
+ - Introduction: software/machine-learning/introduction.md
+ - TensorFlow: software/machine-learning/tensorflow.md
- 'Numerical languages':
- Introduction: software/numerical-languages/introduction.md
- R: software/numerical-languages/r.md
diff --git a/todelete b/todelete
index 4331faf75..ecc2f20e6 100644
--- a/todelete
+++ b/todelete
@@ -24,3 +24,7 @@ docs.it4i/salomon/software/numerical-languages/r.md
./docs.it4i/salomon/software/ansys/licensing.md
./docs.it4i/salomon/software/ansys/setting-license-preferences.md
./docs.it4i/salomon/software/ansys/workbench.md
+./docs.it4i/anselm/software/machine-learning/introduction.md
+./docs.it4i/anselm/software/machine-learning/tensorflow.md
+./docs.it4i/salomon/software/machine-learning/introduction.md
+./docs.it4i/salomon/software/machine-learning/tensorflow.md
--
GitLab