blob: c894c4b5e0b8c6695a9621f848aa78286ef3e27f (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
|
#+TITLE: Genenetwork2 Dockerized
* Table of Contents :TOC:
- [[#introduction][Introduction]]
- [[#creating-the-docker-images][Creating the Docker Images]]
- [[#pushing-to-dockerhub][Pushing to DockerHub]]
* Introduction
The CI(Continuous Integration) system for Genenetwork2 uses [[https://github.com/features/actions][Github
Actions]]. As such, it's important to have a way to run tests using
facilities provided by GUIX in a reproducible way. This project
leverages GUIX to generate a docker container from which the unittests
are ran from.
Find instructions on how to set docker up inside GUIX [[https://github.com/pjotrp/guix-notes/blob/master/CONTAINERS.org#run-docker][here]]. This
document will not get into that. It's assumed that you have a working
docker setup.
The rest of this document outlines how the docker container used in
the CI builds was created.
* Creating the Docker Images
The general idea is that GUIX is used to generate a set of binaries,
which will be added to a base mariaDB image.
First create the gn2 tar archive by running:
#+begin_src sh
# For the Python 2 version:
env GUIX_PACKAGE_PATH="/home/bonface/projects/guix-bioinformatics:/home/bonface/projects/guix-past/modules" \
./pre-inst-env guix pack --no-grafts\
-S /gn2-profile=/ \
screen genenetwork2
# For the Python 3 version:
env GUIX_PACKAGE_PATH="/home/bonface/projects/guix-bioinformatics:/home/bonface/projects/guix-past/modules" \
./pre-inst-env guix pack --no-grafts\
-S /gn2-profile=/ \
screen python3-genenetwork2
#+end_src
The output will look something similar to:
: /gnu/store/x3m77vwaqcwba24p5s4lrb7w2ii16lj9-tarball-pack.tar.gz
Now create a folder from which will host the following dockerfile. You
can name this file Dockerfile. Note that mariadb is the base image
since it already has mariadb installed for us.
#+begin_src conf :mkdirp yes :tangle ~/docker/Dockerfile
FROM mariadb:latest
COPY ./gn2.tar.gz /tmp/gn2.tar.gz
RUN tar -xzf /tmp/gn2.tar.gz -C / && rm -f /tmp/gn2.tar.gz && \
mkdir -p /usr/local/mysql /genotype_files/genotype/json
#+end_src
Build the image(Note the fullstop at the end):
: sudo docker build -t python3-genenetwork2:latest -f Dockerfile .
To load the image interactively you've just created:
: docker run -ti "python3-genenetwork2:latest" bash
Assuming you have a docker instance running, you could always run
commands in it e.g:
: docker run "python2-genenetwork2:latest" python --version
* Pushing to DockerHub
We use DockerHub to store the docker images from which we use on our
CI environment using Github Actions.
To push to dockerhub, first get the image name by running =docker
images=. Push to dockerhub using a command similar to:
: docker push bonfacekilz/python3-genenetwork2:latest
Right now, we have 2 images on DockerHub:
- https://hub.docker.com/repository/docker/bonfacekilz/python2-genenetwork2:
Contains the python2 version of gn2. Don't use this. Please use the
python3 image!
- https://hub.docker.com/repository/docker/bonfacekilz/python3-genenetwork2:
Contains the python3 version of gn2.
|
