Despite a thorough read of https://slurm.schedmd.com/slurm.conf.html, there is several things I don't understand regarding how Slurm manages the memory resource. My slurm.conf contains
DefMemPerCPU=1000
SchedulerType=sched/backfill
SelectType=select/cons_res
SelectTypeParameters=CR_Core_Memory
NodeName=orion Gres=gpu:RTX2080Ti:4 MemSpecLimit=2048 RealMemory=95232
- When not specifying
--mem, jobs are launched withMIN_MEMORY=0and don't seem to fail when allocating memory. What is the maximum memory job can use and how to display it? - When specifying
--mem=0, jobs are pending waiting for resources. How can this be? - The value provided in
DefMemPerCPU=1000doesn't seem to have an effect. Is it related toSelectTypeParameters=CR_Core_Memory? If so, what is the equivalent for CPU cores? - Ultimately, what should be the configuration for having a default memory limit?