aboutsummaryrefslogtreecommitdiff
path: root/genenetwork-development.scm
AgeCommit message (Collapse)Author
13 daysAdd cron job for running transform-genenetwork-database-gexp.Munyoki Kilyungi
13 daysDelete %transform-genenetwork-database-export-directory.Munyoki Kilyungi
* genenetwork-development.scm (%transform-genenetwork-database-export-directory): Delete. (set-build-directory-permissions-gexp): Remove %transform-genenetwork-database-export-directory.
13 daysRename transform-genenetwork-database.Munyoki Kilyungi
* genenetwork-development.scm (transform-genenetwork-database): Rename this to... (transform-genenetwork-database-project): ... this. (transform-genenetwork-database-project): Ditto.
13 daysMake %virtuoso-data-dir writeable by laminar.Munyoki Kilyungi
Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com>
13 daysRefactor ttl and data-loading into Virtuoso in ci job.Munyoki Kilyungi
* genenetwork-development.scm (transform-genenetwork-database): Use a script to generate and validate ttl files. (%connection-settings): New variable. Contains the sparql and mysql login credentials. (%virtuoso-data-dir): New variable. (transform-genenetwork-database-project): Update how the transform-genenetwork-database gexp is called. Add web hook.
2024-10-18Move directory permissions setting G-exp into separate variable.Arun Isaac
* genenetwork-development.scm (set-build-directory-permissions-gexp): New variable. * genenetwork-development.scm (operating-system)[services]: Use set-build-directory-permissions-gexp.
2024-10-18Provide UTF-8 locale so characters are encoded correctly.Munyoki Kilyungi
* genenetwork-development.scm (gn-gemtext-threads-project)[ci-jobs]: Set LC_ALL environment variable. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net>
2024-10-18Explicitly set AUTH_SERVER_URL in gn3.conf.Munyoki Kilyungi
This fixes an issue where gn3 auth defaults to "auth.genenetwork.org" during query execution. Instead we explicitly set AUTH_SERVER_URL to "auth-cd.genenetwork.org"
2024-09-12Enable AI Search in GN2 CD.Munyoki Kilyungi
2024-06-19Replace tabs with white spaces.Munyoki Kilyungi
* genenetwork-development.scm: Run "M-x untabify".
2024-06-19Move xapian re-indexing checks into the indexing script.Munyoki Kilyungi
Let the python xapian indexing script check the checksums, instead of using a G-expression. This approach is simpler and more understandable; it is also more versatile and allows easier modification. * genenetwork-development.scm (build-xapian-index-cron-gexp): Use the indexing script to compare checksums. If the checksums changed, queue the genenetwork3-build-xapian-index laminar job. Co-authored-by: John Nduli <rookie101@jnduli.co.ke>
2024-06-17Configure CI for guile-lapack.Arun Isaac
* genenetwork-development.scm (guile-lapack-project): New variable. (operating-system)[services]{forge-service-type}: Add guile-lapack-project.
2024-06-17Configure CI for guile-gsl.Arun Isaac
* genenetwork-development.scm (guile-gsl-project): New variable. (operating-system)[services]{forge-service-type}: Add guile-gsl-project.
2024-05-02Mount llm-db-path into genenetwork3 container.Arun Isaac
* genenetwork-development.scm (genenetwork-shepherd-services): Mount llm-db-path into genenetwork3 container.
2024-04-28Add llm-db-path for CD.Alexander_Kabui
genenetwork-development.scm (<genenetwork-configuration>)[llm-db-path]: New field. (genenetwork3-cd-gexp): Configure LLM_DB_PATH in gn3.conf. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net>
2024-04-26gn-auth: Use new entry-point script.Frederick Muriuki Muriithi
2024-04-26Set up SSL keys for CI/CD for gn2 and gn-authFrederick Muriuki Muriithi
2024-04-26gn-auth: Update repository URLFrederick Muriuki Muriithi
2024-03-11Infer profile from guix executable used to build container.Arun Isaac
Not everyone has GUIX_PROFILE set in their environment. Inferring the profile from the guix executable is more reliable. * genenetwork-development.scm (channels-scm-gexp): Infer profile from guix executable used to build container.
2024-03-06Move CI/CD configurations from ENVVARS into a file.Frederick Muriuki Muriithi
2024-03-05Pass on the request scheme to GN2 appFrederick Muriuki Muriithi
This is useful to enable building URIs with the correct scheme in the application. These URIs are important when redirection to and from external services such as the gn-auth service.
2024-02-29Bump copyright year for Fred.Arun Isaac
* genenetwork-development.scm: Bump copyright year for Fred.
2024-02-29Do not hard-code GN_AUTH_SECRETS.Arun Isaac
* genenetwork-development.scm (<genenetwork-configuration>)[gn-auth-secrets]: New field. * genenetwork-development.scm (gn-auth-cd-gexp): Set GN_AUTH_SECRTS from gn-auth-secrets of <genenetwork-configuration> object. (operating-system)[services]{genenetwork-service-type}: Set gn-auth-secrets.
2024-02-28Set up correct secrets file for gn-authFrederick Muriuki Muriithi
2024-02-16Run genenetwork auth CD with 8 workers.Arun Isaac
* genenetwork-development.scm (gn-auth-cd-gexp): Run with 8 workers.
2024-02-16Run genenetwork3 CD with 8 workers.Arun Isaac
* genenetwork-development.scm (genenetwork3-cd-gexp): Run with 8 workers.
2024-01-29Update module path in launch of mechanical-rob.Frederick Muriuki Muriithi
With the reorganisation of the modules, and a change in the startup of genenetwork2, the way mechanical-rob is launched has also changed. This commit updates the launch command. * genenetwork-development.scm (genenetwork-projects): Update module path in launch of mechanical-rob CI job. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net>
2024-01-18Configure CI for guile-lmdb.Arun Isaac
* genenetwork-development.scm (guile-lmdb-project): New variable. (operating-system)[services]{forge-service-type}: Add guile-lmdb-project.
2024-01-18Fix channel name on transform-genenetwork-database channel.Arun Isaac
* genenetwork-development.scm (transform-genenetwork-database-project): Fix channel name.
2024-01-08Increase gunicorn timeout for genenetwork3.Arun Isaac
* genenetwork-development.scm (genenetwork3-cd-gexp): Increase gunicorn timeout to 1200 seconds. * genenetwork/services/genenetwork.scm (genenetwork-gunicorn-apps): Add TODO note to increase gunicorn timeout to 1200 seconds.
2024-01-05Set ownership and permissions on secret files.Arun Isaac
* genenetwork-development.scm (genenetwork-activation): Set ownership and permissions on secret files. * genenetwork-development-deploy.sh: Share /etc/genenetwork/conf instead of merely exposing it.
2024-01-05Abstract out gn2/gn3 secrets as configuration fields.Arun Isaac
* genenetwork-development.scm (<genenetwork-configuration>)[gn2-secrets, gn3-secrets]: New fields. * genenetwork-development.scm (genenetwork2-cd-gexp): Use gn2-secrets configuration field. (genenetwork3-cd-gexp): Use gn3-secrets configuration field. (operating-system)[services]: Set gn2-secrets and gn3-secrets fields in genenetwork configuration.
2024-01-02Change path to default genenetwork2 settings file.Arun Isaac
The default settings file in the genenetwork2 code base has been moved from etc/default_settings.py to gn2/default_settings.py. Adapt. * genenetwork-development.scm (genenetwork-projects, genenetwork2-cd-gexp): Change path to default genenetwork2 settings file.
2023-12-30Delete unused qc-tests and qc-project.Arun Isaac
Somehow this code, that was deleted in aaf6750858e061e5f5740fb1edbc49b68b3c4717, was added back in 93ff9ed6fd9f2ca15cf6a8930eae26c9f5c65450. * genenetwork-development.scm (qc-tests, qc-project): Delete variables.
2023-12-30Separate out guix-bioinformatics job that builds all packages.Arun Isaac
We split guix-bioinformatics into two jobs—one that only does a `guix pull' and another that does a `guix pull' and builds all packages. This allows us to catch failures in `guix pull' separately. The job that builds all packages is practically always bound to fail. * genenetwork-development.scm (guix-bioinformatics-project): Split guix-bioinformatics job into guix-bioinformatics and guix-bioinformatics-all-packages jobs.
2023-12-21Simple gn-guile system container buildsPjotr Prins
2023-12-20Use local gn-transform-databases git repository.Arun Isaac
* genenetwork-development.scm (transform-genenetwork-database-project)[repository]: Set to local gn-transform-databases git repository. [ci-jobs-trigger]: Do not use webhook. Reset to default.
2023-12-20Use guix-channel-job-gexp for gn-transform-databases CI job.Arun Isaac
* genenetwork-development.scm: Import (guix ci). (transform-genenetwork-database-tests): Delete variable. (%default-guix-channel-with-substitutes): New variable. (transform-genenetwork-database-project): Use guix-channel-job-gexp for transform-genenetwork-database-tests CI job. * genenetwork/development-helper.scm: Delete file.
2023-12-19Delete unused qc-tests variable.Arun Isaac
* genenetwork-development.scm (qc-tests): Delete variable. * genenetwork/development-helper.scm (asdf-test-gexp): Delete function.
2023-12-19Use guix-channel-job-gexp for gn-auth pylint and mypy CI jobs.Arun Isaac
* genenetwork-development.scm (genenetwork3-tests): Delete function. (gn-auth-pylint): Delete variable. (genenetwork-projects): Build only the gn-auth variable in the gn-auth CI job. Combine gn-auth-mypy and gn-auth-pylint CI jobs into a gn-auth-all-tests job that uses guix-channel-job-gexp. * genenetwork/development-helper.scm (genenetwork-lint-gexp): Delete function.
2023-12-19Use guix-channel-job-gexp for genenetwork3 pylint and mypy CI jobs.Arun Isaac
* genenetwork-development.scm (genenetwork3-mypy, genenetwork3-pylint): Delete variables. (genenetwork-projects): Build only genenetwork3 variable in genenetwork3 CI job. Combine genenetwork3-mypy and genenetwork3-pylint CI jobs into a genenetwork3-all-tests job that uses guix-channel-job-gexp. * genenetwork/development-helper.scm (genenetwork3-lint-gexp): Delete function.
2023-12-19Delete unused genenetwork3-unit-tests variable.Arun Isaac
* genenetwork-development.scm (genenetwork3-unit-tests): Delete variable.
2023-12-19Remove qc-project.Arun Isaac
* genenetwork-development.scm (qc-project): Delete variable. (operating-system)[services]{forge-service-type}: Unlist qc-project.
2023-12-19Rebuild xapian index every hour.Arun Isaac
The xapian index rebuild cron job runs every hour, but doesn't actually rebuild the index unless the MySQL database has changed since the previous index rebuild. * genenetwork-development.scm (operating-system): Run xapian index rebuild job every hour.
2023-12-19Trigger xapian index rebuild conditionally.Arun Isaac
* genenetwork-development.scm: Import mariadb from (gnu packages databases). Import guile-dsv and guile-xapian from (gnu packages guile-xyz). (build-xapian-index-cron-gexp): New variable. (operating-system)[services]: Use build-xapian-index-cron-gexp.
2023-11-13Allow http transport for proxied appFrederick Muriuki Muriithi
The application is behind a proxy and is running as http, therefore, to allow the redirects within the application and responses to work, we need to enable the http transport for the application.
2023-11-13GN Secrets: Set up secrets files for GN2 and GN3Frederick Muriuki Muriithi
2023-11-10auth: define setting for CI/CD auth.Frederick Muriuki Muriithi
2023-11-10Update domain for CD auth service.Frederick Muriuki Muriithi
2023-11-02Secrets: Add instance folder to pola-wrapper.Frederick Muriuki Muriithi