Age | Commit message (Collapse) | Author | |
---|---|---|---|
2024-10-22 | Document emergent general QC structure for CSV files. | Frederick Muriuki Muriithi | |
2024-10-22 | Refactor `qc_pheno_file` and reuse it for different file types. | Frederick Muriuki Muriithi | |
The QC/QA steps taken by the `qc_pheno_file` function are very similar across the "pheno", "phenose" and "phenonum" files. This commit makes the `qc_pheno_file` function a higher-order function and we pass the file-type specific check(s) as a callable (function) to be used for the QC/QA process. | |||
2024-10-22 | Check for errors in `pheno` files. | Frederick Muriuki Muriithi | |
2024-10-21 | Check `phenocovar` files for errors. | Frederick Muriuki Muriithi | |
2024-10-21 | Add utilities for reading text files and csv files | Frederick Muriuki Muriithi | |
The function `read_text_file(…)` will read the raw text file and return the content line by line. The function `read_csv_file(…)` builds on `read_text_file(…)` to read a file as a character-separated-values file. The field separator, and comment_char characters can be provided to customise how the CSV file is read. | |||
2024-10-17 | UI: Create background job when user uploads file. | Frederick Muriuki Muriithi | |
2024-10-17 | Cleanup: Delete all extracted files after processing. | Frederick Muriuki Muriithi | |
2024-10-17 | Leave TODO notes for what needs to be done. | Frederick Muriuki Muriithi | |
2024-10-17 | Fetch samples from database | Frederick Muriuki Muriithi | |
Fetch the samples from the database. These will be used to verify that the samples in the phenotype files already exist in the database and are valid. | |||
2024-10-17 | Undo transpose for any transposed files | Frederick Muriuki Muriithi | |
To reduce the complexity involved in the processing of the files, we undo any transposition of the CSV files for those files that are marked as transposed. | |||
2024-10-17 | Pass new arguments to QC function. | Frederick Muriuki Muriithi | |
2024-10-17 | Add `speciesid` and `populationid` arguments to the script. | Frederick Muriuki Muriithi | |
2024-10-17 | Add the working directory argument to the script. | Frederick Muriuki Muriithi | |
Add a `--working-dir` argument to allow passing a directory where the script process the files within. If not provided, it defaults to a directory within the systems temporary directory. | |||
2024-10-17 | Extract the R/qtl2 bundle for processing. | Frederick Muriuki Muriithi | |
To enable processing of the files individually, this commit will enable the extraction of the files into a known working directory in which all further processing will take place. | |||
2024-10-17 | Extract common functions. | Frederick Muriuki Muriithi | |
2024-10-17 | Save errors for each file in lists. Parallelise error checking. | Frederick Muriuki Muriithi | |
* Save the errors for each file in a redis list for that file. * Make error checking parallel, i.e. ensure every file of a particular type is checked completely independent of other files of the same type. | |||
2024-10-17 | Rewrite the QC code for R/qtl2 | Frederick Muriuki Muriithi | |
2024-10-17 | Ignore comment lines. | Frederick Muriuki Muriithi | |
2024-10-17 | Implement sha256 hashing over file contents. | Frederick Muriuki Muriithi | |
2024-10-17 | Add test for function to compute file hash. | Frederick Muriuki Muriithi | |
2024-10-17 | Rename test module. | Frederick Muriuki Muriithi | |
2024-10-17 | mypy: Fix some typing issues. | Frederick Muriuki Muriithi | |
2024-10-14 | Initialise background script for running QC on phenotype bundles. | Frederick Muriuki Muriithi | |
2024-10-14 | Update typing information. | Frederick Muriuki Muriithi | |
2024-10-14 | BugFix: Use provided prefix | Frederick Muriuki Muriithi | |
Use the provided prefix rather than calling `jobs.jobsnamespace()` function that depends of an app context existing. | |||
2024-10-14 | Make addition of arguments independent of each other. | Frederick Muriuki Muriithi | |
2024-10-14 | Improve error messages for R/qtl2 code. | Frederick Muriuki Muriithi | |
2024-10-14 | Improve UI copy: Add list of files used. | Frederick Muriuki Muriithi | |
2024-10-14 | Improve layout and styling of sidebar content | Frederick Muriuki Muriithi | |
2024-10-10 | UI hints: Help user in choosing the appropriate option. | Frederick Muriuki Muriithi | |
2024-10-10 | Build UI to add new phenotypes. | Frederick Muriuki Muriithi | |
Build the UI and set up styling. This is not working currently. | |||
2024-10-10 | Limit the length of the population description | Frederick Muriuki Muriithi | |
2024-10-07 | Handle "No linked resource" error cleanly. | Frederick Muriuki Muriithi | |
Display the page even if there is no linked resource, but keep the sensitive information hidden in such cases. | |||
2024-10-07 | Add phenotype units to UI | Frederick Muriuki Muriithi | |
2024-10-07 | Reuse requests checks to fix "too many returns" linting error | Frederick Muriuki Muriithi | |
2024-10-07 | linting: Fix minor linting issues. | Frederick Muriuki Muriithi | |
2024-10-07 | Create new phenotype dataset (PublishFreeze). | Frederick Muriuki Muriithi | |
Provide the UI and code to create a new phenotype dataset. | |||
2024-10-07 | Extract reusable input validation code. | Frederick Muriuki Muriithi | |
2024-10-07 | Generalise pagination and paginate phenotypes | Frederick Muriuki Muriithi | |
Generalise the code generating table pagination UI, and use it to paginate the list of phenotypes. | |||
2024-10-02 | Add missing __init__.py | Frederick Muriuki Muriithi | |
2024-10-01 | Add UI elements for possible extra functionality. | Frederick Muriuki Muriithi | |
2024-10-01 | Extract privileges and use them for access control | Frederick Muriuki Muriithi | |
2024-09-30 | BugFix: Ensure all data items show up. | Frederick Muriuki Muriithi | |
2024-09-30 | Initialise views for a specific phenotype | Frederick Muriuki Muriithi | |
Each phenotype is independent, of all others, and they are only put into datasets mostly for easy coralling of phenotypes related to a specific populations. As such, the system will probably need to provide a way to view (and possibly edit) each phenotype independent of all the others. This also fits in with the auth. | |||
2024-09-30 | Extract common check into decorator for reusability. | Frederick Muriuki Muriithi | |
2024-09-27 | Remove unused placeholders for now. | Frederick Muriuki Muriithi | |
2024-09-27 | Improve query for fetching a phenotype dataset's data | Frederick Muriuki Muriithi | |
2024-09-27 | Show some details for a phenotype dataset. | Frederick Muriuki Muriithi | |
2024-09-27 | Extract common functionality into reusable function. | Frederick Muriuki Muriithi | |
2024-09-26 | Start building up the view dataset endpoint | Frederick Muriuki Muriithi | |