| Age | Commit message (Collapse) | Author |
|---|
|
|
|
|
|
|
|
* Display the status of the job, as it is running
* Display STDERR output if an error occurs
* Display STDOUT output as job is running and on successful completion
of the job
|
|
- Hook up external data insertion script to webserver code
- Provide rudimentary status indication
- Generalise some job creation details
|
|
* Fix bug where stderr was not being updated on redis appropriately
|
|
* qc_app/__init__.py (refactor): Check connection before launching the
application
* qc_app/check_connections.py (new file): Add code to check
connections
* qc_app/db_utils.py (refactor): enable passing the database uri as an
argument to the connection creation function.
* scripts/worker.py (refactor): Use new code to check for redis
connection.
|
|
Add a generic worker script, whose purpose is:
- to launch the specific worker script
- to capture both stdin and stderr streams and put them on redis
In this way, we can launch redis-aware and redis-unaware workers and
capture their outputs or errors for later processing.
|
|
As preparation for building a new generic worker script, this commit
renames the file validation script from 'worker.py' to
'validate_file.py' so as to ensure the name conforms better to what
the script does.
|
|
|
|
|
|
Enable the user to abort the background parsing of the file.
|
|
Enable the progress status page to show all the errors found at any
point during the processing of the file.
|
|
- README.org: document how to run scripts manually
- manifest.scm: remove python-rq as a dependency
- qc_app/jobs.py: rework job launching and processing
- qc_app/parse.py: use reworked job processing
- qc_app/templates/job_progress.html: display progress correctly
- qc_app/templates/parse_results.html: display final results
- scripts/worker.py: new worker script
|
