Newer
Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
Resource Allocation and Job Execution
=====================================
To run a [job](../introduction.html), [computational
resources](../introduction.html) for this particular job
must be allocated. This is done via the PBS Pro job workload manager
software, which efficiently distributes workloads across the
supercomputer. Extensive informations about PBS Pro can be found in the
[official documentation
here](../../pbspro-documentation.html), especially in
the [PBS Pro User's
Guide](https://docs.it4i.cz/pbspro-documentation/pbspro-users-guide).
Resources Allocation Policy
---------------------------
The resources are allocated to the job in a fairshare fashion, subject
to constraints set by the queue and resources available to the Project.
[The Fairshare](job-priority.html) at Anselm ensures
that individual users may consume approximately equal amount of
resources per week. The resources are accessible via several queues for
queueing the jobs. The queues provide prioritized and exclusive access
to the computational resources. Following queues are available to Anselm
users:
- **qexp**, the \
- **qprod**, the \***
- **qlong**, the Long queue, regula
- **qnvidia, qmic, qfat**, the Dedicated queues
- **qfree,** the Free resource utilization queue
Check the queue status at <https://extranet.it4i.cz/anselm/>
Read more on the [Resource Allocation
Policy](resources-allocation-policy.html) page.
Job submission and execution
----------------------------
Use the **qsub** command to submit your jobs.
The qsub submits the job into the queue. The qsub command creates a
request to the PBS Job manager for allocation of specified resources.
The **smallest allocation unit is entire node, 16 cores**, with
exception of the qexp queue. The resources will be allocated when
available, subject to allocation policies and constraints. **After the
resources are allocated the jobscript or interactive shell is executed
on first of the allocated nodes.**
Read more on the [Job submission and
execution](job-submission-and-execution.html) page.
Capacity computing
------------------
Use Job arrays when running huge number of jobs.
Use GNU Parallel and/or Job arrays when running (many) single core jobs.
In many cases, it is useful to submit huge (>100+) number of
computational jobs into the PBS queue system. Huge number of (small)
jobs is one of the most effective ways to execute embarrassingly
parallel calculations, achieving best runtime, throughput and computer
utilization. In this chapter, we discuss the the recommended way to run
huge number of jobs, including **ways to run huge number of single core
jobs**.
Read more on [Capacity
computing](capacity-computing.html) page.