View source for SLURM Using Features and Constraints



= Using Features/Constraints with SLURM[[#Using-FeaturesConstraints-with-SLURM|Â¶]] =

Features/Constraints allow users to make very specific requests to the scheduler such as what interconnect your application prefers, how much available memory you require, whether you mind running on low priority machines, etc. To get the most out of the queuing environment, it is very useful to have a reasonable understanding of how the features work and which features you should request for your type of application.



== Important Features[[#Important-Features|Â¶]] ==

The following table lists custom defined features/constraints which are necessary for getting your job to run on the right hardware.

<table>
<tbody>
<tr class="odd">
<td align="left">'''Feature Name'''</td>
<td align="left">'''Value'''</td>
<td align="left">'''Description'''</td>
<td align="left">'''Default'''</td>
</tr>
<tr class="even">
<td align="left"><tt>--time</tt></td>
<td align="left">Wall clock time limit</td>
<td align="left">Request and set a certain amount of run-time for your job. Jobs are killed when they reach this limit</td>
<td align="left">1 hour</td>
</tr>
<tr class="odd">
<td align="left"><tt>--mem</tt></td>
<td align="left">Memory per node</td>
<td align="left">mem (defined in megabytes) will set the amount of memory allocated per node. (For serial jobs)</td>
<td align="left">512MB (0.5GB)</td>
</tr>
<tr class="even">
<td align="left"><tt>--mem-per-cpu</tt></td>
<td align="left">Memory per core</td>
<td align="left">mem (defined in megabytes) will set the amount of memory allocated per cpu core. (For multi-core jobs)</td>
<td align="left">512MB (0.5GB)</td>
</tr>
</tbody>
</table>



== Requesting Features/Constraints[[#Requesting-FeaturesConstraints|Â¶]] ==

To request a feature/constraint, you must add the following line to your submit script:<br />


<pre>#SBATCH --constraint=&lt;feature_name&gt;[,&lt;feature_name&gt;][,...]</pre>
<br />
 or<br />


<pre>#SBATCH --constraint=&lt;feature_name&gt;
#SBATCH --constraint=&lt;feature_name&gt;
...</pre>
<br />
 where &lt;feature_name&gt; is one of the features defined above (or one of the standard features described in the [[SLURMUsers|SLURM User's Guide]] and shown below).

An example:

<pre>#!/bin/bash
#SBATCH --name=my_job_needs_qdr_infiniband
#SBATCH --time=02:00:00
#SBATCH --ntasks=8
#SBATCH --mem-per-cpu=4096
#SBATCH --constraint=ib_qdr
#SBATCH --output=output.$SLURM_JOB_ID
mpirun /opt/apps/my_app/my_binary</pre>
* Job requests 2 hours of runtime (time=02:00:00)
* Job requests 32GB of memory (4GB per CPU)
* Job requests only nodes with Quad Data Rate Infiniband



== Feature Table[[#Feature-Table|Â¶]] ==

This is a table of user-addressable SLURM features. You can request machines with a variety of characteristics such as machines with a certain amount of memory or a particular architecture type.

<table>
<tbody>
<tr class="odd">
<td align="left">'''Feature'''</td>
<td align="left">'''Description'''</td>
</tr>
<tr class="even">
<td align="left">cpu_amd</td>
<td align="left">Select only nodes with AMD cpus</td>
</tr>
<tr class="odd">
<td align="left">cpu_xeon</td>
<td align="left">Select only nodes with Intel Xeon cpus only</td>
</tr>
<tr class="even">
<td align="left">gpu_T10</td>
<td align="left">Select only nodes with T10 GPU (used with --gres. Refer to the [[SLURMGPU|GPU Guide]] for more info)</td>
</tr>
<tr class="odd">
<td align="left">gpu_M2070</td>
<td align="left">Select only nodes with M2070 GPU (used with --gres. Refer to the [[SLURMGPU|GPU Guide]] for more info)</td>
</tr>
<tr class="even">
<td align="left">gpu_K20</td>
<td align="left">Select only nodes with K20 GPU (used with --gres. Refer to the [[SLURMGPU|GPU Guide]] for more info)</td>
</tr>
<tr class="odd">
<td align="left">ib_sdr</td>
<td align="left">Select only nodes with Infiniband Single Data Rate</td>
</tr>
<tr class="even">
<td align="left">ib_ddr</td>
<td align="left">Select only nodes with Infiniband Double Data Rate</td>
</tr>
<tr class="odd">
<td align="left">ib_qdr</td>
<td align="left">Select only nodes with Infiniband Quad Data Rate</td>
</tr>
<tr class="even">
<td align="left">ib_ofa</td>
<td align="left">Select only nodes with Mellanox Infiniband cards</td>
</tr>
<tr class="odd">
<td align="left">ib_psm</td>
<td align="left">Select only nodes with QLOGIC Infiniband cards</td>
</tr>
<tr class="even">
<td align="left">opteron_2220</td>
<td align="left">Select only nodes with AMD Opteron 2220 CPU chips</td>
</tr>
<tr class="odd">
<td align="left">opteron_2384</td>
<td align="left">Select only nodes with AMD Opteron 2384 CPU chips</td>
</tr>
<tr class="even">
<td align="left">opteron_2427</td>
<td align="left">Select only nodes with AMD Opteron 2427 CPU chips</td>
</tr>
<tr class="odd">
<td align="left">sse4</td>
<td align="left">Select only nodes with sse4 (and above) CPU instruction set</td>
</tr>
<tr class="even">
<td align="left">sse41</td>
<td align="left">Select only nodes with sse41 (and above) CPU instruction set</td>
</tr>
<tr class="odd">
<td align="left">sse4a</td>
<td align="left">Select only nodes with sse4a (and above) CPU instruction set</td>
</tr>
<tr class="even">
<td align="left">sse42</td>
<td align="left">Select only nodes with sse4a (and above) CPU instruction set</td>
</tr>
<tr class="odd">
<td align="left">tpa</td>
<td align="left">Select only nodes in Tampa</td>
</tr>
<tr class="even">
<td align="left">wh</td>
<td align="left">Select only nodes in Winter Haven</td>
</tr>
<tr class="odd">
<td align="left">xeon_X5355</td>
<td align="left">Select only nodes with Intel Xeon X5355 CPU chips</td>
</tr>
<tr class="even">
<td align="left">xeon_X5460</td>
<td align="left">Select only nodes with Intel Xeon X5460 CPU chips</td>
</tr>
<tr class="odd">
<td align="left">xeon_E5649</td>
<td align="left">Select only nodes with Intel Xeon E5649 CPU chips</td>
</tr>
<tr class="even">
<td align="left">xeon_E7330</td>
<td align="left">Select only nodes with Intel Xeon E7330 CPU chips</td>
</tr>
<tr class="odd">
<td align="left">xeon_E52630</td>
<td align="left">Select only nodes with Intel Xeon E5-2630 CPU chips</td>
</tr>
<tr class="even">
<td align="left">xeon_E52650</td>
<td align="left">Select only nodes with Intel Xeon E5-2650 CPU chips</td>
</tr>
<tr class="odd">
<td align="left">xeon_E52670</td>
<td align="left">Select only nodes with Intel Xeon E5-2670 CPU chips</td>
</tr>
</tbody>
</table>