diff options
| author | Pjotr <wrk@bosa.lan> | 2026-10-22 09:02:53 +0000 |
|---|---|---|
| committer | Pjotr <wrk@bosa.lan> | 2026-10-22 09:02:53 +0000 |
| commit | 4c692148e6de551ef7c83677b5f1e5ca11e05df7 (patch) | |
| tree | e573ca630ad74810e6e92035936905777486faef /session.md | |
| parent | 07298ef6b812cd07a7c505fec12cc765cfaf319b (diff) | |
| download | hmf-guix-cwl-main.tar.gz | |
docs: Record the GPU investigation and its two blockers. main
The host does have an RTX 5080 (driver 610.43.02), but it cannot be used from here and would not work with the packaged DJL stack anyway: - the sandbox has no nvidia device nodes (/dev is a private tmpfs with only null/zero/full/random/urandom/tty/fuse), CapEff=0 so mknod is denied, and there is no libcuda.so* anywhere; only the kernel module is visible through /proc/driver/nvidia; - DJL's newest CUDA native is pytorch-native-cu124 (PyTorch 2.5.1), and the libtorch_cuda.so in our cu121 bundle carries sm_35..sm_90 kernels only - no sm_100/sm_120, which is what Blackwell needs (CUDA 12.8+). The plausible route is written down for whoever has the device: DJL 0.39 (pytorch-jni 2.7.1; all 17 DJL classes v-chord/v-cuppa import are unchanged) plus a system libtorch 2.7.1+cu128 via PYTORCH_LIBRARY_PATH. README's v-chord paragraph now states the same facts instead of "wait for a cu128 runtime".
Diffstat (limited to 'session.md')
| -rw-r--r-- | session.md | 32 |
1 files changed, 31 insertions, 1 deletions
diff --git a/session.md b/session.md index d18fe00..f4522d7 100644 --- a/session.md +++ b/session.md @@ -199,8 +199,38 @@ ravanan (`cwl-directory-and-array-support`): | item | state | |------------------------------------------|-------| +| GPU (RTX 5080) from this sandbox | impossible: `/dev` is a private tmpfs with no `nvidia*` nodes, `CapEff=0` so `mknod` is denied, and no `libcuda.so*` exists anywhere (`/`, `/gnu/store`); only the kernel module is visible via `/proc/driver/nvidia` | +| GPU with the packaged DJL stack | impossible even on the host: newest DJL native is `pytorch-native-cu124` 2.5.1 (CUDA 12.4 -> `sm_90`), the card is `sm_120`; our cu121 `libtorch_cuda.so` lists `sm_35`…`sm_90` only | +| GPU, plausible route (host only) | DJL 0.39 (`pytorch-jni` 2.7.1, all 17 DJL classes used are unchanged) + system libtorch 2.7.1+cu128 via `PYTORCH_LIBRARY_PATH`; needs the device visible and a ~2.5 GB download | | `workflows/wigits.cwl` execution | not run end to end: needs an Ensembl cache, GC profile, BAF loci VCF, LILAC resources and indexed BAMs; `qc.cwl` and `dir-handoff.cwl` are the executable proofs | | ravanan cwltest e2e / conformance suites | not buildable here: `cwltest` -> `python-cheroot` fails two SSL assertions on this OpenSSL | -| v-chord GPU leg | needs a DJL runtime with `sm_120` kernels (cu128) for RTX 50-series cards | | ravanan branch | `cwl-directory-and-array-support`, 6 commits local; not merged, not sent upstream | +## 11. GPU investigation + +The host has an NVIDIA GeForce RTX 5080 (driver 610.43.02, open kernel +module), visible through `/proc/driver/nvidia`. Two independent blockers +prevent using it: + +| blocker | evidence | +|------------------------------------------------|----------| +| no device access from the sandbox | `/dev` is a private tmpfs carrying only `null`, `zero`, `full`, `random`, `urandom`, `tty`, `fuse`; `CapEff=0` so `mknod` fails with `EPERM`; no `libcuda.so*` under `/`, `/gnu/store` or `/usr/lib` | +| the card needs CUDA 12.8+, DJL ships CUDA 12.4 | newest DJL artifact is `pytorch-native-cu124` 2.5.1; `strings libtorch_cuda.so` from the 2.2.2/cu121 bundle lists `sm_35`…`sm_90` and no `sm_100`/`sm_120`, so a Blackwell card fails with "no kernel image is available for execution on the device" | + +What would be needed to go further, in order of cost: + +1. run `test/test-vchord.sh` on the host, where `/dev/nvidia*` and + `/usr/lib/x86_64-linux-gnu/libcuda.so.1` exist — still fails on the + second blocker; +2. bump the channel's DJL stack to 0.39 (the API is compatible: all 17 + DJL classes v-chord and v-cuppa import still exist), install + `pytorch-jni` 2.7.1-0.39.0, and point `PYTORCH_LIBRARY_PATH` at a + libtorch 2.7.1+cu128 build from download.pytorch.org (~2.5 GB). That + is the first combination that could execute on this card, and it needs + a machine with the device visible; +3. or bind-mount `/dev/nvidia*` and the host's `libcuda.so.1` into the + sandbox — only the host owner can do that, and it does not help until + step 2 is done. + +Until then the CPU leg of `test/test-vchord.sh` and `v-chord-e2e` in the +CWL suite remain the GPU-less proofs. |
