A job on the Pawsey supercomputers fails with "slurmstepd: error: Exceeded job memory limit at some point."
This shows that the job has exhausted all the memory available on a core/node. This error can occur shortly after the job has started, or much later in execution, depending on the demand for memory by the application. These are the two options to solve this problem:
- Reduce the memory requirement of the application (which may mean reducing the problem size, but may also mean checking for the possibility of memory leaks if you are developing your own code);
- Increase the memory available to the application by reducing the number of tasks within a node. In the case of Zeus, explicitly request for more memory for each task.
|Content by Label|
|cql||label in ("exceeded","memory","limit","slurm") and type = "page" and space = "US"|
|labels||memory limit exceeded|