aboutsummaryrefslogtreecommitdiff
path: root/scripts
AgeCommit message (Expand)Author
2022-08-05Update job status. Display stdout and stderr outputs...* Display the status of the job, as it is running * Display STDERR output if an error occurs * Display STDOUT output as job is running and on successful completion of the job Frederick Muriuki Muriithi
2022-08-04Implement data insertion...- Hook up external data insertion script to webserver code - Provide rudimentary status indication - Generalise some job creation details Frederick Muriuki Muriithi
2022-08-04Handle stderr output...* Fix bug where stderr was not being updated on redis appropriately Frederick Muriuki Muriithi
2022-08-04Format queries for output. Get rid of extraneous output.Frederick Muriuki Muriithi
2022-07-19Save standard error data. Fix linting and typing errors.Frederick Muriuki Muriithi
2022-07-19Implement data insertion (averages/means)...* quality_control/file_utils.py (new file): extract common file utilities. * quality_control/parsing.py (refactor): extract common file utilities. * scripts/insert_data.py: Implement data insertion for averages/means Frederick Muriuki Muriithi
2022-07-19Check connections before launching...* qc_app/__init__.py (refactor): Check connection before launching the application * qc_app/check_connections.py (new file): Add code to check connections * qc_app/db_utils.py (refactor): enable passing the database uri as an argument to the connection creation function. * scripts/worker.py (refactor): Use new code to check for redis connection. Frederick Muriuki Muriithi
2022-07-19Add generic worker script...Add a generic worker script, whose purpose is: - to launch the specific worker script - to capture both stdin and stderr streams and put them on redis In this way, we can launch redis-aware and redis-unaware workers and capture their outputs or errors for later processing. Frederick Muriuki Muriithi
2022-07-19Rename file validation script...As preparation for building a new generic worker script, this commit renames the file validation script from 'worker.py' to 'validate_file.py' so as to ensure the name conforms better to what the script does. Frederick Muriuki Muriithi
2022-07-07Replace 'magic' with builtin 'mimetypes'...Use the builtin mimetypes which gives better results Frederick Muriuki Muriithi
2022-06-28Check for inconsistent columns...The number columns in each contents line should be equal to the nember of columns in the header line. Frederick Muriuki Muriithi
2022-06-15Fix linting and type errorsFrederick Muriuki Muriithi
2022-06-10Enable upload of zipfilesFrederick Muriuki Muriithi
2022-06-02Enable user abortion of file parsing...Enable the user to abort the background parsing of the file. Frederick Muriuki Muriithi
2022-06-02Add an error display to the progress status report...Enable the progress status page to show all the errors found at any point during the processing of the file. Frederick Muriuki Muriithi
2022-05-19Update Web-UI: use new error collection paradigm...- README.org: document how to run scripts manually - manifest.scm: remove python-rq as a dependency - qc_app/jobs.py: rework job launching and processing - qc_app/parse.py: use reworked job processing - qc_app/templates/job_progress.html: display progress correctly - qc_app/templates/parse_results.html: display final results - scripts/worker.py: new worker script Frederick Muriuki Muriithi
2022-05-19Extract progress indication from the parsing...Since progress indication is not part of the parsing, this commit extracts the progress indication into functions with well defined input arguments that hide the progress indication logic from the parsing function. Frederick Muriuki Muriithi
2022-05-18Update CLI: use new error collection code...Use the new code that collects the errors in the CLI client. Frederick Muriuki Muriithi
2022-05-11Tag string as a python f-string to fix error display bugFrederick Muriuki Muriithi
2022-05-02Optimise strain names parsing...- Use a way faster way of parsing the strains file Frederick Muriuki Muriithi
2022-04-27Enable managing app via setup.py...While the application is developed with GNU Guix, the end user might not be using it, and therefore, this commit provides a way for the user to install the application with the usual python package management systems. Frederick Muriuki Muriithi