about summary refs log tree commit diff
path: root/genenetwork/services/julia-notebook.scm
diff options
context:
space:
mode:
authorPjotr Prins <pjotr.public01@thebird.nl>2026-11-16 00:41:19 +0000
committerPjotr Prins <pjotr.public01@thebird.nl>2026-11-16 00:41:19 +0000
commit39e091835268f0bc38df3efc7fe4c94dd5e7d1d7 (patch)
treef4874a8e146375805c5ccc66998e23eb1d4be8a9 /genenetwork/services/julia-notebook.scm
parent7e52abdde8d36cb2f805d2c2d40aa123e9d168c1 (diff)
downloadgn-machines-main.tar.gz
slurm-container: 30 CPUs, honest memory, and a one-second scheduler HEAD main
The node declared CPUs=2, which is not the container's capacity: the
container sees all 96 host CPUs (affinity 0-95) and 754 GB of RAM. Measured
with a 30-job probe, the old declaration ran 2 at a time; ravanan's LOCO
workflow (20 chromosomes x kinship+gwa) took 102 s cold against 14.3 s
single-machine.

Now: CPUs=30, RealMemory=65536, DefMemPerCPU=1024 (so a job that requests no
memory no longer takes the whole node's), SlurmdParameters=config_overrides
(the conf, not slurmd's probe, decides the node's size), and a one-second
scheduler/backfill cycle so a 40-job scatter starts in one go.

Measured after: 30 of 30 plain jobs RUNNING within a second, and ravanan's
cold LOCO run down from 102 s to 24.7 s with the same 21 051 rows.

Two things learned the hard way, both now in the comments:

*  takes the *host* path. Passing the
  container-side spelling (/tmp/ai-root/slurm-share) drops the mount
  silently, and every job then dies with signal 53 and no stdout/stderr --
  which looks like a Slurm bug, not a missing mount.
* a node that declares fewer CPUs than it has is a lie that costs 4x, but
  declaring more than it has does not oversubscribe the hardware: the CPU
  count is what Slurm *schedules* on, and the kernel still runs the jobs.
Diffstat (limited to 'genenetwork/services/julia-notebook.scm')
0 files changed, 0 insertions, 0 deletions