aboutsummaryrefslogtreecommitdiff
path: root/dump.scm
AgeCommit message (Expand)Author
2023-05-26Update how publications are dumped•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-05-26Dump phenotypes•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-05-26Delete dump-published-phenotypes•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-05-26When a field is null during annotation, return an empty string•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-05-26Replace chars not allowed in RDF•••* dump.scm (sanitize-rdf-string): New function Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-05-26Dump molecular traits, also referred to as Probesets•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-05-26Update how inbred-set in dumped•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-05-26Update how Species are dumped•••* dump.scm (dump-species): Rename gn:menuName to gn:displayName. Add gn:family and up:organism triplets. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Delete "operation" from fields•••Nested raw queries: ((field (query alias)) alias) are now supported so an "operation is not needed". * dump.scm (field->key, field->assoc-ref): Delete ((field table column operation alias) alias)) Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Update GeneRIF prefix•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add species data to generif entries•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Dump genewiki symbol•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Annotate gn:geneWikiEntry as a class and add a comment•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Dump species, symbols and indicate generif type when a geneid = 0•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Separate NCBI and GN wikientries in dump•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add dublin-core and uniprot prefixes•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Avoid prefixing 'pubmed: to an empty string•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Delete generif file dump•••* dump.scm (decode-html-entities, import-generif): Delete. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Refactor dump-generif-basic/dump-generif to dump-gn-genewiki-entries•••* dump.scm (dump-generif, dump-generif-basic): Refactor to ... (dump-gn-genewiki-entries): ... this. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Redefine how genewiki is dumped•••* dump.scm (dump-generif, dump-generif-basic): Replace with ... (dump-gn-genewiki-entries): ... this. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Split substring int a list of substrings delimited by substring•••* dump.scm (string-split-substring): New function. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add new special form for representing blank nodes•••* dump.scm (blank-node): New macro. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Allow running raw queries in field form•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Make dumping metadata about a given table optional defaulting to #f•••* dump.scm (define-dump): Add optional table-metadata? flag thats #f by default. If this flag is #t, dump metadata about the SQL table itself. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add "xsd:" and "owl:" prefixes•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Annotate fields with a custom scheme such as "^^xsd:datetime"•••* dump.scm (annotate-field): New function. * dump/triples.scm (triple): Print a string as they appear with DISPLAY should they contain "\"" thus enabling a triple that looks like: gn:species_mus_musculus gn:name "Mouse"^^xsd:string Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Dump GeneRIF wikidata•••* dump.scm (dump-generif-basic): Annotate createTime field with xsd. * dump.scm (dump-generif): New dump. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add pubmed, taxon and generif prefixes•••Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add ability to have operations such as GROUP_CONCAT in SELECT clause•••This change enables having: "... GROUP_CONCAT(GeneRIF_BASIC.PubMedId) AS alias ..." as part of the query. * dump.scm (field->key, field->assoc-ref): Add new syntax-rule. * dump/sql.scm (select-query): Ditto. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-03-08Dump GeneWiki metadata•••* dump.scm (dump-generif): New data dump. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-03-06Dump relevant metadata about phenotypes•••* dump.scm (dump-publishfreeze, dump-published-phenotypes): New dumps. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-03-06Delete phenotype and publish_xref metadata•••* dump.scm (phenotype-id->id, dump-phenotype): Delete (dump-publish-xref): Delete. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-03-06Add mapping method and species info to inbredsets.•••* dump.scm (dump-inbred-set): Add mapping method and species as extra metadata for inbredsets. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-02-15Remove dump-case-attributes•••This information is already stored in LMDB. * dump.scm (dump-case-attributes): Delete. (main)(<dump-case-attributes>): Ditto. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2022-12-06Use InfoPageName as a dataset's name.•••* dump.scm (dump-info-files): Set a dataset's name to InfoPageName. Munyoki Kilyungi
2022-11-04Add comment with URI to GeneRIF data.•••* dump.scm: Add comment with URI to GeneRIF data. Arun Isaac
2022-11-04Unite importing GeneRIF with dumping SQL data.•••* README.md: Document generif-data-file parameter in connection settings. * dump.scm: Import (srfi srfi-171), (ice-9 regex) and (zlib). (decode-html-entities, import-generif): New functions. (main): Call import-generif. * import-generif.scm: Delete file. Arun Isaac
2022-10-30Move triple utilities to new module.•••* dump.scm (string->identifier, string-blank?, triple, prefix): Move to ... * dump/triples.scm: ... new file. * dump.scm: Import (dump triples). Arun Isaac
2022-10-30Move string-blank? to (dump utils).•••* dump.scm (string-blank?): Move to ... * dump/utils.scm (string-blank?): ... here. Arun Isaac
2022-10-30Special case Yohan Bossé's last name.•••* dump.scm (dump-investigators): Special case Yohan Bossé's last name. Arun Isaac
2022-10-30Do not deduplicate the AvgMethod table.•••The AvgMethod table no longer has duplicate "N/A" records. * dump.scm (dump-avg-method): Do not deduplicate the AvgMethod table. Arun Isaac
2022-08-20Add gn:traitId and gn:publicationId.•••In GeneNetwork, a phenonytpe is currently identified by it's ID (primary key of the table from MariaDB). The only way to relate it to a publication is through a publication ID. This is important because there are some publications with a NULL value for "pubmed ID" and as such without the publication ID, some data is lost as there's no way to point to publication with a NULL "pubmed ID." * dump.scm (dump-publish-xref): Define gn:traitId and gn:publicationId. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net> Munyoki Kilyungi
2022-06-24Delete vertical tab character in publication abstracts.•••* dump.scm (dump-publication): Delete vertical tab character in abstracts. Arun Isaac
2022-06-23Dump groups.•••* dump.scm (dump-groups): New dump. (main): Call dump-groups. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net> BonfaceKilz
2022-06-23Dump case-attributes.•••* dump.scm (dump-case-attributes): New dump. (main): Call dump-case-attributes. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net> BonfaceKilz
2022-06-23Remove "." if it occurs at the end of a turtle identifier.•••A "." at the end of a turtle identifier---for example "gn:caseAttribute_ethn."---generates an error when trying to validate the generated RDF. * dump.scm (string->identifier): Remove trailing "." if it occurs in the identifier. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net> BonfaceKilz
2022-05-05Prefix SQL connection parameters with sql-.•••This differentiates it from virtuoso and SPARQL connection parameters. * dump.scm (call-with-genenetwork-database, dump-data-table): Prefix SQL connection parameters with sql-. * README.md (Using): Update documentation of SQL connection parameters. Arun Isaac
2022-05-04Special case investigator ID for "Yohan Bossé".•••* dump.scm (investigator-attributes->id): Add special case for investigator "Yohan Bossé". Arun Isaac
2022-03-10Ignore 0th command-line argument.•••* dump.scm (%connection-settings): Use 1th command-line argument. (%dump-directory): Use 2th command-line argument. Arun Isaac
2022-03-10Accept connection parameters and dump directory as arguments.•••* dump.scm: Import (rnrs programs). (%connection-settings): New variable. (call-with-database): Use %connection-settings. (%database-name): Delete variable. (%dump-directory): Set from command-line arguments. (dump-data-table): Use %connection-settings instead of %database-name. * README.org (Using): Add command-line arguments to usage instructions. Arun Isaac