about summary refs log tree commit diff
path: root/uploader/phenotypes
AgeCommit message (Collapse)Author
2025-06-26Narrow search to only uploaded traits.Frederick Muriuki Muriithi
2025-06-24Use positional parameters rather than named ones.Frederick Muriuki Muriithi
Named parameters were causing problems on staging, where the names would be converted into bytestrings and then used to index into the dictionaries, leading to `KeyError` exceptions.
2025-06-24Use pathlib.Path object for file paths.Frederick Muriuki Muriithi
2025-06-17Allow users to provide transposed files.Frederick Muriuki Muriithi
2025-06-10Display the success page.Frederick Muriuki Muriithi
2025-06-10Pass on the publication to the next job.Frederick Muriuki Muriithi
2025-06-10Bug: Fix logging.Frederick Muriuki Muriithi
2025-06-10Provide handler for `load-new-phenotypes-data` jobs.Frederick Muriuki Muriithi
2025-06-10On success, redirect to job status check page.Frederick Muriuki Muriithi
2025-06-10Display the error.Frederick Muriuki Muriithi
2025-06-10Set loglevel for background job's launcher.Frederick Muriuki Muriithi
2025-06-05Request token for use with script to update authorisationsFrederick Muriuki Muriithi
After the script has completed loading the data into the database, the user who uploads the data will need to access the data they've uploaded. This commit requests a new token to use with the script for updating the authorisations as appropriate, to grant the user access to their data.
2025-06-03Save data with `LOAD DATA INFILE …` queryFrederick Muriuki Muriithi
To help speed up the saving of the data (for really huge files) into the database, use the `LOAD DATA INFILE …` command if available, and if not fallback to the one using raw queries.
2025-06-03Increase number of rows per query.Frederick Muriuki Muriithi
2025-06-03Debug the query: useful to figure out what's happening.Frederick Muriuki Muriithi
2025-06-03Memory saving: Don't reload saved dataFrederick Muriuki Muriithi
We already have all the data in memory, so we do not need to reload it and keep yet another copy.
2025-06-02Add some debugging statements.Frederick Muriuki Muriithi
2025-06-02Parametrize the "DataId" column for different tables.Frederick Muriuki Muriithi
2025-06-02Explicitly query for newly entered data.Frederick Muriuki Muriithi
The `cursor.executemany()` call only returned the last row that was inserted, rather than ALL the rows. This is not the correct thing to do, therefore, this commit fixes that by explicitly querying for all the newly entered data.
2025-05-30Add dataset_id and bundle path to job metadata.Frederick Muriuki Muriithi
2025-05-30Fix typo: Fix table name.Frederick Muriuki Muriithi
2025-05-30Bug: Loop until the data is exhausted.Frederick Muriuki Muriithi
2025-05-30Fix typo, and bug.Frederick Muriuki Muriithi
2025-05-30Fix indentation.Frederick Muriuki Muriithi
2025-05-30Use full table names rather than aliasesFrederick Muriuki Muriithi
Using aliases leads to errors when you have to use table locking to prevent data corruption. This commit updates queries to use the full table names rather than aliases, in order to prevent such troubles.
2025-05-19Provide extra metadata to the job.Frederick Muriuki Muriithi
2025-05-19Provide missing URI to the MariaDB database to the script.Frederick Muriuki Muriithi
2025-05-19Add function to save the numerical data for phenotypes.Frederick Muriuki Muriithi
2025-05-12Use builtin functions to compute log level.Frederick Muriuki Muriithi
2025-05-05Init setup and script for async job to load phenotypes into databaseFrederick Muriuki Muriithi
2025-05-05Save/Create new phenotypes in the database.Frederick Muriuki Muriithi
2025-05-05Provide endpoint for loading data after QC is successful.Frederick Muriuki Muriithi
2025-05-05Include the publication when provided.Frederick Muriuki Muriithi
2025-04-21Proceed to jobs status update page.Frederick Muriuki Muriithi
2025-04-21Use module-specific logger.Frederick Muriuki Muriithi
2025-04-21Add "DataId" to top-level trait details.Frederick Muriuki Muriithi
The `DataId` is unique in the `PublishXRef` table.
2025-04-14Fix typo.Frederick Muriuki Muriithi
2025-04-14Move common fieldnames into exportable variable.Frederick Muriuki Muriithi
2025-04-14Implement difference computations.Frederick Muriuki Muriithi
2025-04-14Add tests for new difference computation function.Frederick Muriuki Muriithi
2025-04-14Log out job command for easier debug.Frederick Muriuki Muriithi
2025-04-14Provide species, population and dataset identifiers as job metadata.Frederick Muriuki Muriithi
2025-03-26Pass in system log-level to script.Frederick Muriuki Muriithi
2025-03-26Provide connection URI for mariadb.Frederick Muriuki Muriithi
2025-03-26Update comment text.Frederick Muriuki Muriithi
2025-03-25Run job with unbuffered outputs.Frederick Muriuki Muriithi
2025-03-25Update name of launcher script used.Frederick Muriuki Muriithi
2025-03-24Begin processing the uploadeded bulk-edit file.Frederick Muriuki Muriithi
2025-03-21Add "PubMed_ID" fieldFrederick Muriuki Muriithi
The "PubMed_ID" field allows the user to edit the publication that's attached to each phenotype trait.
2025-03-21Bulk Edit: Initialise the bulk-edit uploadFrederick Muriuki Muriithi
* Provide UI for uploading the file * Provide (partially implemented) endpoint to handle the uploaded file.