Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
it4i-modules
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Container registry
Model registry
Operate
Environments
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
SCS
it4i-modules
Commits
ac8eb125
Commit
ac8eb125
authored
6 years ago
by
Lukáš Krupčík
Browse files
Options
Downloads
Plain Diff
Merge branch '1-nespravne-trideni-modulu' into 'master'
Enabled CI Closes
#1
See merge request
!3
parents
86499350
31b78e76
Branches
jakob-old-montrack-001
No related tags found
1 merge request
!3
Enabled CI
Pipeline
#5286
passed with warnings
6 years ago
Stage: test
Changes
6
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
6 changed files
.gitlab-ci.yml
+21
-0
21 additions, 0 deletions
.gitlab-ci.yml
.pylintrc
+7
-0
7 additions, 0 deletions
.pylintrc
README.md
+1
-0
1 addition, 0 deletions
README.md
get_modules.sh
+30
-48
30 additions, 48 deletions
get_modules.sh
modules.py
+3
-2
3 additions, 2 deletions
modules.py
test.sh
+0
-24
0 additions, 24 deletions
test.sh
with
62 additions
and
74 deletions
.gitlab-ci.yml
0 → 100644
+
21
−
0
View file @
ac8eb125
stages
:
-
test
docs
:
stage
:
test
image
:
davidhrbac/docker-mdcheck:latest
allow_failure
:
true
script
:
-
mdl -r ~MD024,~MD013,~MD033,~MD014,~MD026,~MD037,~MD036,~MD010,~MD029 *.md
pylint
:
stage
:
test
image
:
davidhrbac/docker-pycheck:latest
script
:
-
pylint --max-module-lines=3000 *.py
shellcheck
:
stage
:
test
image
:
davidhrbac/docker-shellcheck:latest
script
:
-
shellcheck *.sh
This diff is collapsed.
Click to expand it.
.pylintrc
0 → 100644
+
7
−
0
View file @
ac8eb125
[FORMAT]
# Maximum number of characters on a single line.
max-line-length=150
# Maximum number of lines in a module
max-module-lines=1000
This diff is collapsed.
Click to expand it.
README.md
+
1
−
0
View file @
ac8eb125
# List of Modules on Clusters
# List of Modules on Clusters
Generate lists
Generate lists
*
Salomon - login4
*
Salomon - login4
*
Anselm - login2
*
Anselm - login2
...
...
This diff is collapsed.
Click to expand it.
get_modules.sh
+
30
−
48
View file @
ac8eb125
#!/bin/bash
#!/bin/bash
# vim: ai ts=2 sw=2 et sts=2 ft=sh
PWD
=
"/home/easybuild/git/it4i-modules"
PWD
=
"/home/easybuild/git/it4i-modules"
cd
$PWD
cd
$PWD
STATE
=
$(
git fetch 2>&1 |
grep
master
)
STATE
=
$(
git fetch 2>&1 |
grep
master
)
if
[
!
-z
"
$STATE
"
]
;
then
if
[
!
-z
"
$STATE
"
]
;
then
git pull
git pull
./get_modules.sh
./get_modules.sh
exit
0
exit
0
fi
fi
if
[
!
-z
`
hostname
-f
|
grep
"bullx"
`
]
;
then
if
hostname
-f
|
grep
-q
"bullx"
;
then
ml
--show-hidden
-t
av
2>&1
>
/dev/null|
awk
'{print $1 ",1"}'
|
grep
-v
-e
'/,\|:'
|
sort
-u
>
anselm.csv
ml
--show-hidden
-t
av
>
/dev/null
2>&1
|
awk
'{print $1 ",1"}'
|
grep
-v
-e
'/,\|:'
|
sort
-u
>
anselm.csv
./modules.py
>
anselm.md
./modules.py
>
anselm.md
else
else
ml
--show-hidden
-t
av
2>&1
>
/dev/null|
awk
'{print $1 ",2"}'
|
grep
-v
-e
'/,\|:'
|
sort
-u
>
salomon.csv
ml
--show-hidden
-t
av
>
/dev/null
2>&1
|
awk
'{print $1 ",2"}'
|
grep
-v
-e
'/,\|:'
|
sort
-u
>
salomon.csv
./modules.py
>
salomon.md
./modules.py
>
salomon.md
MODULEBASE
=
"/appsuv/modules"
for
resource
in
"/appsuv/modules,uv2000"
"/apps/phi/modules,phi"
MODULEPATH
=
""
do
MODULEBASE
=
${
resource
%,*
}
MODULEPATH
=
""
FILENAME
=
${
resource
#*,
}
for
dir
in
`
ls
$MODULEBASE
`
for
dir
in
$MODULEBASE
do
do
# Exclude following directories
# Exclude following directories
if
[[
(
$dir
==
"all"
)
]]
;
then
if
[[
(
$(
basename
$dir
)
==
"all"
)
]]
;
then
continue
continue
fi
fi
# In case that it's directory
# In case that it's directory
if
[
-d
$MODULEBASE
/
$dir
]
;
then
if
[
-d
$dir
]
;
then
if
[
-z
$MODULEPATH
]
;
then
if
[
-z
$MODULEPATH
]
;
then
MODULEPATH
=
"
$MODULEBASE
/
$dir
"
MODULEPATH
=
$dir
else
else
MODULEPATH
=
"
$MODULEPATH
:
$MODULEBASE
/
$dir
"
MODULEPATH
=
"
$MODULEPATH
:
$MODULEBASE
/
$dir
"
fi
fi
fi
fi
done
done
export
MODULEPATH
export
MODULEPATH
ml
--show-hidden
-t
av 2>&1
>
/dev/null|
awk
'{print $1 ",4"}'
|
grep
-v
-e
'/,\|:'
|
sort
-u
>
uv2000.csv
./modules.py
>
uv2000.md
MODULEBASE
=
"/apps/phi/modules"
MODULEPATH
=
""
for
dir
in
`
ls
$MODULEBASE
`
do
# Exclude following directories
if
[[
(
$dir
==
"all"
)
]]
;
then
continue
fi
# In case that it's directory
if
[
-d
$MODULEBASE
/
$dir
]
;
then
if
[
-z
$MODULEPATH
]
;
then
MODULEPATH
=
"
$MODULEBASE
/
$dir
"
else
MODULEPATH
=
"
$MODULEPATH
:
$MODULEBASE
/
$dir
"
fi
fi
done
export
MODULEPATH
ml
--show-hidden
-t
av
>
/dev/null 2>&1|
awk
'{print $1 ",4"}'
|
grep
-v
-e
'/,\|:'
|
sort
-u
>
"
$FILENAME
"
.csv
./modules.py
>
"
$FILENAME
"
.md
ml
--show-hidden
-t
av 2>&1
>
/dev/null|
awk
'{print $1 ",8"}'
|
grep
-v
-e
'/,\|:'
|
sort
-u
>
phi.csv
done
./modules.py
>
phi.md
fi
fi
DATE
=
$(
date
-R
)
DATE
=
$(
date
-R
)
...
...
This diff is collapsed.
Click to expand it.
modules.py
+
3
−
2
View file @
ac8eb125
#!/usr/bin/env python
#!/usr/bin/env python
"""
Script to generate module lists
"""
import
os
import
os
import
re
import
re
...
@@ -67,8 +68,8 @@ if __name__ == "__main__":
...
@@ -67,8 +68,8 @@ if __name__ == "__main__":
first_module_path
=
os
.
path
.
join
(
software_path
,
software_versions
[
0
])
first_module_path
=
os
.
path
.
join
(
software_path
,
software_versions
[
0
])
software_url
,
software_description
=
get_module_description
(
first_module_path
)
software_url
,
software_description
=
get_module_description
(
first_module_path
)
HTML_SOURCE_DATA
[
subdir
][
soft
]
=
{
'
versions
'
:
[],
HTML_SOURCE_DATA
[
subdir
][
soft
]
=
{
'
versions
'
:
[],
'
url
'
:
software_url
,
'
url
'
:
software_url
,
'
description
'
:
software_description
}
'
description
'
:
software_description
}
for
version
in
software_versions
:
for
version
in
software_versions
:
HTML_SOURCE_DATA
[
subdir
][
soft
][
'
versions
'
].
append
(
version
)
HTML_SOURCE_DATA
[
subdir
][
soft
][
'
versions
'
].
append
(
version
)
if
software_url
in
[
""
,
"
(none)
"
]:
if
software_url
in
[
""
,
"
(none)
"
]:
...
...
This diff is collapsed.
Click to expand it.
test.sh
deleted
100755 → 0
+
0
−
24
View file @
86499350
#!/bin/bash
MODULEBASE
=
"/apps/phi/modules"
MODULEPATH
=
""
for
dir
in
`
ls
$MODULEBASE
`
do
# Exclude following directories
if
[[
(
$dir
==
"all"
)
]]
;
then
continue
fi
# In case that it's directory
if
[
-d
$MODULEBASE
/
$dir
]
;
then
if
[
-z
$MODULEPATH
]
;
then
MODULEPATH
=
"
$MODULEBASE
/
$dir
"
else
MODULEPATH
=
"
$MODULEPATH
:
$MODULEBASE
/
$dir
"
fi
fi
done
export
MODULEPATH
./modules.py
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment