aboutsummaryrefslogtreecommitdiff
path: root/scripts/worker.py
AgeCommit message (Expand)Author
2024-07-25Rename module: qc_app --> uploaderFrederick Muriuki Muriithi
2024-01-24Checks: Update code and tests to ensure all checks pass.Frederick Muriuki Muriithi
2024-01-23Update scripts to use redis prefix.Frederick Muriuki Muriithi
2024-01-22UI: Show progress of R/qtl2 bundle processing.Frederick Muriuki Muriithi
2023-11-15Linting: Fix linting errors.Frederick Muriuki Muriithi
2022-08-05Update job status. Display stdout and stderr outputs...* Display the status of the job, as it is running * Display STDERR output if an error occurs * Display STDOUT output as job is running and on successful completion of the job Frederick Muriuki Muriithi
2022-08-04Implement data insertion...- Hook up external data insertion script to webserver code - Provide rudimentary status indication - Generalise some job creation details Frederick Muriuki Muriithi
2022-08-04Handle stderr output...* Fix bug where stderr was not being updated on redis appropriately Frederick Muriuki Muriithi
2022-07-19Check connections before launching...* qc_app/__init__.py (refactor): Check connection before launching the application * qc_app/check_connections.py (new file): Add code to check connections * qc_app/db_utils.py (refactor): enable passing the database uri as an argument to the connection creation function. * scripts/worker.py (refactor): Use new code to check for redis connection. Frederick Muriuki Muriithi
2022-07-19Add generic worker script...Add a generic worker script, whose purpose is: - to launch the specific worker script - to capture both stdin and stderr streams and put them on redis In this way, we can launch redis-aware and redis-unaware workers and capture their outputs or errors for later processing. Frederick Muriuki Muriithi
2022-07-19Rename file validation script...As preparation for building a new generic worker script, this commit renames the file validation script from 'worker.py' to 'validate_file.py' so as to ensure the name conforms better to what the script does. Frederick Muriuki Muriithi
2022-06-15Fix linting and type errorsFrederick Muriuki Muriithi
2022-06-10Enable upload of zipfilesFrederick Muriuki Muriithi
2022-06-02Enable user abortion of file parsing...Enable the user to abort the background parsing of the file. Frederick Muriuki Muriithi
2022-06-02Add an error display to the progress status report...Enable the progress status page to show all the errors found at any point during the processing of the file. Frederick Muriuki Muriithi
2022-05-19Update Web-UI: use new error collection paradigm...- README.org: document how to run scripts manually - manifest.scm: remove python-rq as a dependency - qc_app/jobs.py: rework job launching and processing - qc_app/parse.py: use reworked job processing - qc_app/templates/job_progress.html: display progress correctly - qc_app/templates/parse_results.html: display final results - scripts/worker.py: new worker script Frederick Muriuki Muriithi