aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2024-02-05Retrieve list of all files, and list of missing filesFrederick Muriuki Muriithi
Add QC a function to list all files listed in the control file, and another to list only the files missing from the bundle.
2024-02-05Update UI documentationFrederick Muriuki Muriithi
Improve the UI documentation by making it more explicit what each section deals with to help aleviate confusion of what the different features do.
2024-02-02List file types in a single place for easier reuseFrederick Muriuki Muriithi
2024-02-02Ensure control file defaults are set up in code.Frederick Muriuki Muriithi
2024-02-02Bug: Specify DictCursor class to return dict-like resultFrederick Muriuki Muriithi
Without specifying the `cursorclass`, the result is a tuple of the form: ((query_col01_val, query_col02_val, ...), ...) where the ellipsis specify the possibility of more than one of the previous form. We specify the DictCursor class instead so that the form changes to: ({query_col01_name: query_col01_val, ...}, ...) which allows us to pick the value we want with a string index.
2024-01-24Checks: Update code and tests to ensure all checks pass.Frederick Muriuki Muriithi
2024-01-24redis-prefix: update "upload samples" pathFrederick Muriuki Muriithi
2024-01-24redis-prefix: Update "insert data" path.Frederick Muriuki Muriithi
2024-01-24redis-prefix: Update file validation codeFrederick Muriuki Muriithi
Update the file validation script and routes to use the redis prefix for jobs.
2024-01-23Update scripts to use redis prefix.Frederick Muriuki Muriithi
2024-01-23Add prefix to redis keysFrederick Muriuki Muriithi
Since the GNQC application might find itself sharing the same redis server and/or database with other applications, add a prefix to its keys.
2024-01-23Tests: Use prefixes in tests rather than starting redis serverFrederick Muriuki Muriithi
It's easier, and more robust to put the data under a prefix within a redis database rather than try to run a redis server, especially within the test environment. This commit updates the tests to use a redis prefix instead.
2024-01-22UI: Fix some UI bugs.Frederick Muriuki Muriithi
2024-01-22scripts: Pass in logger to get detailed updates.Frederick Muriuki Muriithi
2024-01-22UI: Show progress of R/qtl2 bundle processing.Frederick Muriuki Muriithi
2024-01-20Fetch sample/case names from databaseFrederick Muriuki Muriithi
Fetch the sample/case names from the database rather than from a static file in the repository. Issue: https://issues.genenetwork.org/issues/quality-control/read-samples-from-database-by-species
2024-01-19scripts: Process R/qtl2 bundleFrederick Muriuki Muriithi
Build script to start the processing of the R/qtl2 bundle.
2024-01-19UI: Present entry point for R/qtl2 bundles upload.Frederick Muriuki Muriithi
2024-01-18UI: Display summary information.Frederick Muriuki Muriithi
2024-01-18UI: Create new ProbeSet dataset.Frederick Muriuki Muriithi
2024-01-18UI: Select from existing ProbeSet datasets.Frederick Muriuki Muriithi
2024-01-18Create new ProbeSet study.Frederick Muriuki Muriithi
2024-01-17UI: Select ProbeSet study.Frederick Muriuki Muriithi
2024-01-17UI: Implement creating new genotype datasets.Frederick Muriuki Muriithi
2024-01-17UI: Initialise summary page.Frederick Muriuki Muriithi
2024-01-17Enable selecting from existing genotype datasets.Frederick Muriuki Muriithi
2024-01-17Update flash-messages' categories.Frederick Muriuki Muriithi
2024-01-16UI: Create UI for creating a new Genotype dataset.Frederick Muriuki Muriithi
2024-01-16UI: Create UI to select from existing genotype datasets.Frederick Muriuki Muriithi
2024-01-16Create intermediate stepFrederick Muriuki Muriithi
We do not have the option to modify the request and then redirect with the modification in place. To go around that, this commit creates an intermediate step that informs the user of their progress, while allowing us to store the filename for future steps.
2024-01-16Build a sha512 hash from the uploaded file's name and timestampFrederick Muriuki Muriithi
Build a sha512 message digest from the file's name and the timestamp of when the file was uploaded. This ensures that the filename is URL-safe, and reduces chances of name conflicts in the upload directory which could lead to data corruption when processing the files and saving the files into the database.
2024-01-16Filter out items with values of `None`.Frederick Muriuki Muriithi
The ProbeSetData table does not allow `NULL` for the `value` column for good reason - if there is no value, just don't have a record for that particular sample.
2024-01-16Provide defaults for various control variablesFrederick Muriuki Muriithi
`na.strings` has a default value of "NA" as stated in https://kbroman.org/qtl2/assets/vignettes/input_files.html#CSV_files quote: > Missing value codes will be specified in the control file (as > na.strings, with default value "NA") and will apply across all > files, so a missing value code for one file cannot be an allowed > value in another file. for `comment.char` > The CSV files can include a header with a set of comment lines > initiated by a value specified in the control file as comment.char > (with default value "#"). for `sep`: The default separator is expected to be the comma, as stated in https://kbroman.org/qtl2/assets/vignettes/input_files.html#field-separator quote: > If the data files use a separator other than a comma ...
2024-01-15Update imports: `take` was moved to different package.Frederick Muriuki Muriithi
2024-01-15Process `na.strings` even for default casesFrederick Muriuki Muriithi
There was a bug where the `na.strings` were not processed correctly if the user called the `r_qtl.r_qtl2.file_data(...)` function without explicitly providing the `process_*` arguments. This commit fixes that.
2024-01-15Extract common functional tools to separate package.Frederick Muriuki Muriithi
2024-01-15Process the `pheno` files.Frederick Muriuki Muriithi
Process the data in the pheno files and insert it into the database.
2024-01-15Initialise `install_phenos` script.Frederick Muriuki Muriithi
2024-01-15Extract common structure into separate modules.Frederick Muriuki Muriithi
2024-01-11Update pmap data in the database.Frederick Muriuki Muriithi
2024-01-11Update gmap data in the databaseFrederick Muriuki Muriithi
Update the genetic positions (in centiMorgans) in the database.
2024-01-11Cleanup linting and typing errors.Frederick Muriuki Muriithi
2024-01-11CLI: Require datasetid as an argument.Frederick Muriuki Muriithi
2024-01-10Provide convenience functions to avoid subtle call errorsFrederick Muriuki Muriithi
2024-01-10Cross-reference genotype data to the dataset.Frederick Muriuki Muriithi
2024-01-10Insert genotype data.Frederick Muriuki Muriithi
2024-01-10Cross-reference individuals to populations.Frederick Muriuki Muriithi
2024-01-10Insert any new individuals/samples into the database.Frederick Muriuki Muriithi
2024-01-10Insert any new markersFrederick Muriuki Muriithi
Insert any new markers found into the database.
2024-01-10Make identifier column name explicitFrederick Muriuki Muriithi
Since the R/qtl2 bundle generator could name the identifier column anything, this commit converts the incoming identifier column name into something explicit that we know and can use.