aboutsummaryrefslogtreecommitdiff
path: root/scripts
AgeCommit message (Expand)Author
2024-02-05Run QC on the 'geno' file in R/qtl2 bundle.Frederick Muriuki Muriithi
2024-02-05Add a QC step: Check all listed files exist...Add a QC step to the R/qtl2 bundle processing - check that all files that are listed in the control file also exist in the bundle. Frederick Muriuki Muriithi
2024-02-05Fix linting and type errors.Frederick Muriuki Muriithi
2024-01-24Checks: Update code and tests to ensure all checks pass.Frederick Muriuki Muriithi
2024-01-24redis-prefix: Update file validation code...Update the file validation script and routes to use the redis prefix for jobs. Frederick Muriuki Muriithi
2024-01-23Update scripts to use redis prefix.Frederick Muriuki Muriithi
2024-01-22scripts: Pass in logger to get detailed updates.Frederick Muriuki Muriithi
2024-01-22UI: Show progress of R/qtl2 bundle processing.Frederick Muriuki Muriithi
2024-01-20Fetch sample/case names from database...Fetch the sample/case names from the database rather than from a static file in the repository. Issue: https://issues.genenetwork.org/issues/quality-control/read-samples-from-database-by-species Frederick Muriuki Muriithi
2024-01-19scripts: Process R/qtl2 bundle...Build script to start the processing of the R/qtl2 bundle. Frederick Muriuki Muriithi
2024-01-16Filter out items with values of `None`....The ProbeSetData table does not allow `NULL` for the `value` column for good reason - if there is no value, just don't have a record for that particular sample. Frederick Muriuki Muriithi
2024-01-15Update imports: `take` was moved to different package.Frederick Muriuki Muriithi
2024-01-15Process the `pheno` files....Process the data in the pheno files and insert it into the database. Frederick Muriuki Muriithi
2024-01-15Initialise `install_phenos` script.Frederick Muriuki Muriithi
2024-01-15Extract common structure into separate modules.Frederick Muriuki Muriithi
2024-01-11Update pmap data in the database.Frederick Muriuki Muriithi
2024-01-11Update gmap data in the database...Update the genetic positions (in centiMorgans) in the database. Frederick Muriuki Muriithi
2024-01-11Cleanup linting and typing errors.Frederick Muriuki Muriithi
2024-01-11CLI: Require datasetid as an argument.Frederick Muriuki Muriithi
2024-01-10Provide convenience functions to avoid subtle call errorsFrederick Muriuki Muriithi
2024-01-10Cross-reference genotype data to the dataset.Frederick Muriuki Muriithi
2024-01-10Insert genotype data.Frederick Muriuki Muriithi
2024-01-10Cross-reference individuals to populations.Frederick Muriuki Muriithi
2024-01-10Insert any new individuals/samples into the database.Frederick Muriuki Muriithi
2024-01-10Insert any new markers...Insert any new markers found into the database. Frederick Muriuki Muriithi
2024-01-09WIP: Install genotypes from R/qtl2 bundle...Load the genotype information from the R/qtl2 bundle and insert it into the database. Frederick Muriuki Muriithi
2024-01-09Fix linting errorsFrederick Muriuki Muriithi
2024-01-09scripts: Log to redis...Add a logger that will log output to a redis list. This will be useful to retrieve the output(s) of the running script to help display some form of progress to the user. Frederick Muriuki Muriithi
2024-01-08Use extracted functions and fix bugsFrederick Muriuki Muriithi
2023-12-20Fix ID column key...Fix the wrong assumption that the ID key will always be "ProbeSetID". The key for the ID column could change from study to study or dataset to dataset. Frederick Muriuki Muriithi
2023-12-18Samples: Hook-up external async script to upload the samples.Frederick Muriuki Muriithi
2023-12-14samples: Create external script and fix some bugs.Frederick Muriuki Muriithi
2023-11-30Bug: Fix insertion error...Fix a bug that was causing the data insertion to fail. Frederick Muriuki Muriithi
2023-11-30Fix errors caught by pylint and mypy.Frederick Muriuki Muriithi
2023-11-15Log out DB errors even when handled...Log out any DB errors that occur to help with tracking and debugging failures. Frederick Muriuki Muriithi
2023-11-15Remove debugging statement.Frederick Muriuki Muriithi
2023-11-15Bug: Insert ProbeSets before average data and cross-refs...Insert the ProbeSets first before inserting the average data and cross-referencing it. Frederick Muriuki Muriithi
2023-11-15mypy: Fix typing errors.Frederick Muriuki Muriithi
2023-11-15Linting: Fix linting errors.Frederick Muriuki Muriithi
2023-10-30Prevent overwrite. Avoid inserting same probeset multiple times....* Avoid overwriting existing data by adding a random string to the name of the ProbeSet * Read ProbeSet names separately from the means for the strains, to avoid entering the same ProbeSet record over and over with varying names. Frederick Muriuki Muriithi
2023-10-18Link to `ProbeSet.Id` in XRef Table...The "ProbeSetId" value in the file is actually stored in the database in the `ProbeSet.Name` field, whereas the `ProbeSetXRef` table actually uses the `ProbeSet.Id` value to define the relationships. This commit fixes that issue. Frederick Muriuki Muriithi
2023-10-16Fix bug: Insert ProbeSets if they do not exist.Frederick Muriuki Muriithi
2023-10-16Fix bug: Provide the platform_id to `insert_means`Frederick Muriuki Muriithi
2023-10-16Fix bug: parsing fields from query.Frederick Muriuki Muriithi
2022-08-05Update job status. Display stdout and stderr outputs...* Display the status of the job, as it is running * Display STDERR output if an error occurs * Display STDOUT output as job is running and on successful completion of the job Frederick Muriuki Muriithi
2022-08-04Implement data insertion...- Hook up external data insertion script to webserver code - Provide rudimentary status indication - Generalise some job creation details Frederick Muriuki Muriithi
2022-08-04Handle stderr output...* Fix bug where stderr was not being updated on redis appropriately Frederick Muriuki Muriithi
2022-08-04Format queries for output. Get rid of extraneous output.Frederick Muriuki Muriithi
2022-07-19Save standard error data. Fix linting and typing errors.Frederick Muriuki Muriithi
2022-07-19Implement data insertion (averages/means)...* quality_control/file_utils.py (new file): extract common file utilities. * quality_control/parsing.py (refactor): extract common file utilities. * scripts/insert_data.py: Implement data insertion for averages/means Frederick Muriuki Muriithi