aboutsummaryrefslogtreecommitdiff
path: root/scripts/worker.py
AgeCommit message (Collapse)Author
2022-07-19Add generic worker scriptFrederick Muriuki Muriithi
Add a generic worker script, whose purpose is: - to launch the specific worker script - to capture both stdin and stderr streams and put them on redis In this way, we can launch redis-aware and redis-unaware workers and capture their outputs or errors for later processing.
2022-07-19Rename file validation scriptFrederick Muriuki Muriithi
As preparation for building a new generic worker script, this commit renames the file validation script from 'worker.py' to 'validate_file.py' so as to ensure the name conforms better to what the script does.
2022-06-15Fix linting and type errorsFrederick Muriuki Muriithi
2022-06-10Enable upload of zipfilesFrederick Muriuki Muriithi
2022-06-02Enable user abortion of file parsingFrederick Muriuki Muriithi
Enable the user to abort the background parsing of the file.
2022-06-02Add an error display to the progress status reportFrederick Muriuki Muriithi
Enable the progress status page to show all the errors found at any point during the processing of the file.
2022-05-19Update Web-UI: use new error collection paradigmFrederick Muriuki Muriithi
- README.org: document how to run scripts manually - manifest.scm: remove python-rq as a dependency - qc_app/jobs.py: rework job launching and processing - qc_app/parse.py: use reworked job processing - qc_app/templates/job_progress.html: display progress correctly - qc_app/templates/parse_results.html: display final results - scripts/worker.py: new worker script