From a09d5a19c8be1ba305ee09089bcdac39fa3c53e5 Mon Sep 17 00:00:00 2001 From: Frederick Muriuki Muriithi Date: Wed, 31 Dec 2025 11:59:03 -0600 Subject: Update issue with notes. --- issues/gn-uploader/replace-redis-with-sqlite3.gmi | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/issues/gn-uploader/replace-redis-with-sqlite3.gmi b/issues/gn-uploader/replace-redis-with-sqlite3.gmi index 3e5020a..d3f94f0 100644 --- a/issues/gn-uploader/replace-redis-with-sqlite3.gmi +++ b/issues/gn-uploader/replace-redis-with-sqlite3.gmi @@ -15,3 +15,15 @@ We currently (as of 2024-06-27) use Redis for tracking any asynchronous jobs (e. A lot of what we use redis for, we can do in one of the many SQL databases (we'll probably use SQLite3 anyway), which are more standardised, and easier to migrate data from and to. It has the added advantage that we can open multiple connections to the database, enabling the different processes to update the status and metadata of the same job consistently. Changes done here can then be migrated to the other systems, i.e. GN2, GN3, and gn-auth, as necessary. + +### 2025-12-31: Progress Update + +Initial basic implementation can be found in: + +=> https://git.genenetwork.org/gn-libs/tree/gn_libs/jobs +=> https://git.genenetwork.org/gn-uploader/commit/?id=774a0af9db439f50421a47249c57e5a0a6932301 +=> https://git.genenetwork.org/gn-uploader/commit/?id=589ab74731aed62b1e1b3901d25a95fc73614f57 + +and others. + +More work needs to be done to clean-up some minor annoyances. -- cgit 1.4.1