diff options
| author | Pjotr Prins <pjotr.public01@thebird.nl> | 2026-11-16 00:41:19 +0000 |
|---|---|---|
| committer | Pjotr Prins <pjotr.public01@thebird.nl> | 2026-11-16 00:41:19 +0000 |
| commit | 39e091835268f0bc38df3efc7fe4c94dd5e7d1d7 (patch) | |
| tree | f4874a8e146375805c5ccc66998e23eb1d4be8a9 /genenetwork/containers/cgit-container.scm | |
| parent | 7e52abdde8d36cb2f805d2c2d40aa123e9d168c1 (diff) | |
| download | gn-machines-main.tar.gz | |
The node declared CPUs=2, which is not the container's capacity: the container sees all 96 host CPUs (affinity 0-95) and 754 GB of RAM. Measured with a 30-job probe, the old declaration ran 2 at a time; ravanan's LOCO workflow (20 chromosomes x kinship+gwa) took 102 s cold against 14.3 s single-machine. Now: CPUs=30, RealMemory=65536, DefMemPerCPU=1024 (so a job that requests no memory no longer takes the whole node's), SlurmdParameters=config_overrides (the conf, not slurmd's probe, decides the node's size), and a one-second scheduler/backfill cycle so a 40-job scatter starts in one go. Measured after: 30 of 30 plain jobs RUNNING within a second, and ravanan's cold LOCO run down from 102 s to 24.7 s with the same 21 051 rows. Two things learned the hard way, both now in the comments: * takes the *host* path. Passing the container-side spelling (/tmp/ai-root/slurm-share) drops the mount silently, and every job then dies with signal 53 and no stdout/stderr -- which looks like a Slurm bug, not a missing mount. * a node that declares fewer CPUs than it has is a lie that costs 4x, but declaring more than it has does not oversubscribe the hardware: the CPU count is what Slurm *schedules* on, and the kernel still runs the jobs.
Diffstat (limited to 'genenetwork/containers/cgit-container.scm')
0 files changed, 0 insertions, 0 deletions
