| Age | Commit message (Collapse) | Author |
|
Carry the file's sample list in the QC job metadata, redirect the QC success
handler to a sample-order review page, and validate the submitted order as a
permutation of the file's samples. On acceptance, launch the next-stage job
(type genotype-stage04) with the accepted order and the preceding stage state in
its metadata; re-submitting reuses an existing Stage 04 job.
Add a minimal Stage 04 placeholder worker for the hand-off point.
Co-authored-by: pi coding agent <pi@pi.dev>
|
|
Add `is_valid_order`, which checks that a submitted order is a permutation of
the file's samples (catching missing, extra and duplicated samples), with tests.
Co-authored-by: pi coding agent <pi@pi.dev>
|
|
Add `proposed_order`, which keeps an existing population order and appends
missing samples alphabetically (or sorts alphabetically without an existing
order), and `population_sample_order`, which reads a population's order from
`StrainXRef.OrderId`.
Co-authored-by: pi coding agent <pi@pi.dev>
|
|
Track marker names per chromosome during Stage 03 QC and report an error for
duplicates within the same chromosome. Marker names may still be reused on
different chromosomes.
Co-authored-by: pi coding agent <pi@pi.dev>
|
|
Set `error_handler` on the genotype statistics collection and QC jobs so
failures render the genotype upload error page. Structured file errors are
listed; other failures fall back to stdout/stderr and recovery guidance.
Co-authored-by: pi coding agent <pi@pi.dev>
|
|
Add `job_errors.errors_from_job`, which normalises the structured errors a
genotype job records in its stdout (collector `FileStats.errors` and QC result
errors), and collector/QC error handler functions that render them. The HTML
template and job-metadata registration follow in separate commits.
Co-authored-by: pi coding agent <pi@pi.dev>
|
|
`initialise_job` now takes metadata as keyword arguments, so replace the
`extra_meta={...}` arguments with `**{...}` at the gn-libs job call sites.
Co-authored-by: pi coding agent <pi@pi.dev>
|
|
Add `uploader.genotypes.normalise`, which writes a canonical untransposed
matrix (`<stem>__work<suffix>`) next to the original, dropping comments and
`@` directives and leaving the original untouched. Ragged or empty matrices
raise `NormalisationError`, and `qc.check_file` now handles only the normal
orientation.
Stage 02 now puts `stage02`, `genotype_collector_job_id`, `file` and `config`
in the QC job's metadata at launch, and uses `jobs_by_metadata` to reuse an
existing QC job. The completed collector job's metadata is no longer modified.
The Stage 03 worker normalises and QCs the working file from its own metadata.
Change the placeholder marker ordering to chromosome, then Mb, then cM.
Co-authored-by: pi coding agent <pi@pi.dev>
|
|
- Store the genotype file path and collector config in the collector job
metadata so later stages can re-read the file.
- Seed `dot_geno_fields.unk` into the Stage 02 missing-value symbols default.
- Add `uploader.genotypes.qc` with value checks (empty and unknown symbols)
and a placeholder marker-ordering helper (chromosome, cM, Mb) that warns.
- Add the `uploader.scripts.genotypes.qc` worker that reads the collector job,
runs the checks and exits non-zero when errors are found.
- On Stage 02 save, schedule the QC job and record its id for idempotency.
|
|
Move `parse_missing_values_symbols` from the genotypes views into
`r_qtl.utils` and use it in the genotypes Stage 01 collector config and the
phenotypes individual-file uploads, replacing their divergent inline splits
with the more robust whitespace/comma parsing. Move the tests to
`tests/r_qtl/test_utils.py`.
|
|
Add a missing-value symbol(s) input to the Stage 02 encoding form and a
`parse_missing_values_symbols` helper in the genotypes views. Parse the input
(whitespace/comma-separated, unique symbols) and store it in the collector
job's `stage02` metadata alongside the description and encoding; prefill the
input when the page is revisited.
|
|
Redirect the collector job's success handler to the new Stage 02 route,
carrying the collector job id. The `study_design` view loads the job, validates
it and parses the FileStats via `collector_job.file_stats`, then renders the
collected description, the genotype symbols, and the study-design/encoding
inputs.
POST stores the confirmed description and encoding in the collector job's
metadata (`stage02`) and redirects back to the review page (post/redirect/get),
which makes revisiting and re-submitting idempotent. Bind the study-design and
encoding fragments to the saved values.
|
|
Validate that a job is a completed genotype-stats job for the requested
species/population/dataset and parse its FileStats from the job's recorded
stdout.
|
|
Move `uploader/scripts/genotypes/types.py` to `uploader/genotypes/types.py` so
application code can use `FileStats` and friends without importing from
`uploader.scripts`. Update the collector script and tests to the new location.
|
|
Add `collector_config.command` to build the collector CLI command from the
collector config. Replace the `_collect_geno_csv_stats_` stub in
`add_genotype_records` with a `gn_libs.jobs` background job that runs the
collector.
The standard background-job status/summary pages surface the collector's
stdout and stderr, so failures show the available diagnostics. JSON requests
receive a `redirect-to` for the job status page; HTML requests are redirected
there too.
Set the collector job's `success_handler` and add
`collect_genotype_stats_success_handler`, which currently redirects to the job
summary page (dumping the job details). It will be replaced by the Stage 02
study-design/encoding flow.
|
|
Add `uploader.genotypes.collector_config.from_form` to map the upload form's
metadata fields to the statistics collector's config keys (`markers`,
`chromosome`, `cm`, `mb`, `transposed`, `separator`, `comment.char`,
`na_strings`), falling back to the collector's defaults and normalising the
missing-value strings.
Use it in `add_genotype_records` instead of the previous `sep`/`na.strings`
stub metadata.
|
|
Wire `add_genotype_records` to `uploader.files.resolve_uploaded_file` for both
the resumable and direct upload paths, replacing the incorrect
`form["uploaded-file"]` lookup. On failure, return a JSON error for JSON
requests, or flash and redirect back to the add-records page.
|
|
|
|
Use python's official documentation format, specified by PEP 287 for
documenting the function's parameters, return and exceptions.
|
|
|
|
|
|
|
|
|
|
|
|
The endpoint can return either HTML or JSON depending on the 'Accept'
header.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Implement a proof-of-concept (PoC) UI for genotype records.
|
|
|
|
A species can have more markers than are considered in a particular
population. This update changes the code to filter the markers by both
species and population to ensure only the markers referenced in the
population actually show up.
|
|
Retrieve all the genetic markers that exist for a particular species
regardless of whether or not a particular marker has corresponding
samples allele data.
|
|
|
|
Get a possibly filtered set of markers ensuring the markers are
specific to the dataset. Also return the total number of markers in
the dataset, even if we do not return the entire list.
|
|
|
|
|
|
|
|
|
|
* Define a default `FEATURE_FLAGS_HTTP` configuration variable that's
an empty list to help defining http-based feature flags that can be
used to turn on/off features
* Build macro to include hidden fields for feature flags where
necessary.
* Extend flask's `url_for` function to deal with defined feature flags
in a mostly transparent way
|
|
|
|
|
|
For UI consistency, and as a convenience to the users, retain the
population details for the "List Markers" page to help them navigate
more easily using the breadcrumbs.
|
|
Use the code in gn-libs to connect to the database, rather than a
local module.
|
|
|
|
|
|
|
|
|