summaryrefslogtreecommitdiff
path: root/topics/hpc/octopus
diff options
context:
space:
mode:
authorPjotr Prins2024-02-11 11:46:13 +0100
committerPjotr Prins2024-02-11 11:46:22 +0100
commit13a2c1c0aad96aed0d1d5a52f6d4aa3b33149956 (patch)
tree07cf62cb353b9e17707d2108842d4d98bf0c4041 /topics/hpc/octopus
parent1af19225191aaf90c1259ce56eefff5bc58339d4 (diff)
downloadgn-gemtext-13a2c1c0aad96aed0d1d5a52f6d4aa3b33149956.tar.gz
On SLURM PBS and R
Diffstat (limited to 'topics/hpc/octopus')
-rw-r--r--topics/hpc/octopus/slurm-user-guide.gmi44
1 files changed, 44 insertions, 0 deletions
diff --git a/topics/hpc/octopus/slurm-user-guide.gmi b/topics/hpc/octopus/slurm-user-guide.gmi
new file mode 100644
index 0000000..d00987a
--- /dev/null
+++ b/topics/hpc/octopus/slurm-user-guide.gmi
@@ -0,0 +1,44 @@
+# Slurm User Guide on Ocotopus HPC
+
+The Octopus HPC uses slurm. There are many online resources for using slurm on HPC, including
+
+=> https://servicedesk.surf.nl/wiki/display/WIKI/SLURM+batch+system
+=> https://www.carc.usc.edu/user-information/user-guides/hpc-basics/slurm-cheatsheet/
+
+In this document we discuss where differences may occur. For one, Octopus is one of the busiest HPCs in the world, no kidding, because of the large scale pangenome effort at UTHSC.
+As a user you will likely notice that. When you plan to fire up large jobs please discuss this on our matrix channel, otherwise jobs may get banned. Also Octopus is run by its users, pretty much in the form of a do-ocracy. Please respect our efforts.
+
+Important warning: Octopus is non-HIPAA. Octopus is not designed to handle sensitive data. Running clinical data without the right permissions is punishable by law. Use designated HIPAA systems for that type of data and analysis.
+
+# Useful commands
+
+sinfo tells you about the slurm nodes:
+
+```
+sinfo -i
+```
+
+sbatch allows you to submit a batch job
+
+```
+sbatch
+```
+
+To get a shell prompt on one of the nodes
+
+```
+srun -N 1 --mem=32G --pty /bin/bash
+```
+
+
+# Differences
+
+## Guix (look ma, no modules)
+
+No modules: Octopus does not use the venerable module system to support deployment. In contrast it uses the modern Guix packaging system. In the future we may add Nix support too.
+
+An example of using R with guix is described here:
+
+=> ../../guix/R
+
+If you choose, you can still use conda, brew, spack, Python virtualenv, and what not. Userland tools will work, even Docker or singularity may work.