aboutsummaryrefslogtreecommitdiff
AgeCommit message (Expand)Author
2023-04-05Split substring int a list of substrings delimited by substring...* dump.scm (string-split-substring): New function. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add new special form for representing blank nodes...* dump.scm (blank-node): New macro. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Allow running raw queries in field form...Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Make dumping metadata about a given table optional defaulting to #f...* dump.scm (define-dump): Add optional table-metadata? flag thats #f by default. If this flag is #t, dump metadata about the SQL table itself. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add "xsd:" and "owl:" prefixes...Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Annotate fields with a custom scheme such as "^^xsd:datetime"...* dump.scm (annotate-field): New function. * dump/triples.scm (triple): Print a string as they appear with DISPLAY should they contain "\"" thus enabling a triple that looks like: gn:species_mus_musculus gn:name "Mouse"^^xsd:string Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Dump GeneRIF wikidata...* dump.scm (dump-generif-basic): Annotate createTime field with xsd. * dump.scm (dump-generif): New dump. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add a method to transform epoch time to a human readable format...* dump/utils.scm: Import srfi-19. Export time-unix->string. (time-unix->string): New function. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add pubmed, taxon and generif prefixes...Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Create a method to define ontologies as symbols...* dump/triples.scm: Export ontology. (ontology): New function. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-04-05Add ability to have operations such as GROUP_CONCAT in SELECT clause...This change enables having: "... GROUP_CONCAT(GeneRIF_BASIC.PubMedId) AS alias ..." as part of the query. * dump.scm (field->key, field->assoc-ref): Add new syntax-rule. * dump/sql.scm (select-query): Ditto. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-03-24Instructions for running in a container and added dependenciesPjotr Prins
2023-03-08Dump GeneWiki metadata...* dump.scm (dump-generif): New data dump. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-03-06Dump relevant metadata about phenotypes...* dump.scm (dump-publishfreeze, dump-published-phenotypes): New dumps. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-03-06Delete phenotype and publish_xref metadata...* dump.scm (phenotype-id->id, dump-phenotype): Delete (dump-publish-xref): Delete. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-03-06Add mapping method and species info to inbredsets....* dump.scm (dump-inbred-set): Add mapping method and species as extra metadata for inbredsets. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-02-15Read metadata from a json file...* json-dump.scm: New file. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2023-02-15Remove dump-case-attributes...This information is already stored in LMDB. * dump.scm (dump-case-attributes): Delete. (main)(<dump-case-attributes>): Ditto. Signed-off-by: Munyoki Kilyungi <me@bonfacemunyoki.com> Munyoki Kilyungi
2022-12-06Use InfoPageName as a dataset's name....* dump.scm (dump-info-files): Set a dataset's name to InfoPageName. Munyoki Kilyungi
2022-11-25Provide a sample conn.scm....* README.md (Using)[Set up connection parameters]: Provide a sample conn.scm. Arun Isaac
2022-11-25Document generif-data-file connection parameter....* README.md (Using)[Set up connection parameters]: Document generif-data-file. Arun Isaac
2022-11-25Split up README into subsections....* README.md (Using): Split into subsections. Arun Isaac
2022-11-04Add comment with URI to GeneRIF data....* dump.scm: Add comment with URI to GeneRIF data. Arun Isaac
2022-11-04Unite importing GeneRIF with dumping SQL data....* README.md: Document generif-data-file parameter in connection settings. * dump.scm: Import (srfi srfi-171), (ice-9 regex) and (zlib). (decode-html-entities, import-generif): New functions. (main): Call import-generif. * import-generif.scm: Delete file. Arun Isaac
2022-11-04Revert "Put isql commands on a single line."...This reverts commit 5aecbcd3e59119533658b792c6dafa0c6efd9d5b. Despite putting commands on a single line, isql still echoes and leaks the password. Arun Isaac
2022-10-31Put isql commands on a single line....We put isql commands on a single line in the hope that they will not be echoed thus leaking the password. * load-rdf.scm (delete-graph): Put isql commands on a single line. Arun Isaac
2022-10-30Import GeneRIF data into RDF....* import-generif.scm: New file. Arun Isaac
2022-10-30Move triple utilities to new module....* dump.scm (string->identifier, string-blank?, triple, prefix): Move to ... * dump/triples.scm: ... new file. * dump.scm: Import (dump triples). Arun Isaac
2022-10-30Move string-blank? to (dump utils)....* dump.scm (string-blank?): Move to ... * dump/utils.scm (string-blank?): ... here. Arun Isaac
2022-10-30Special case Yohan Bossé's last name....* dump.scm (dump-investigators): Special case Yohan Bossé's last name. Arun Isaac
2022-10-30Do not deduplicate the AvgMethod table....The AvgMethod table no longer has duplicate "N/A" records. * dump.scm (dump-avg-method): Do not deduplicate the AvgMethod table. Arun Isaac
2022-10-21Authenticate when deleting graph from virtuoso....* load-rdf.scm (delete-graph): Accept password argument. (main): Call delete-graph with password. Arun Isaac
2022-08-20Add gn:traitId and gn:publicationId....In GeneNetwork, a phenonytpe is currently identified by it's ID (primary key of the table from MariaDB). The only way to relate it to a publication is through a publication ID. This is important because there are some publications with a NULL value for "pubmed ID" and as such without the publication ID, some data is lost as there's no way to point to publication with a NULL "pubmed ID." * dump.scm (dump-publish-xref): Define gn:traitId and gn:publicationId. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net> Munyoki Kilyungi
2022-08-02Add new functions to read CSV files in a flexible way....We add new functions---parse-raw-table and parse-aggregate-table---to parse raw ungrouped data and grouped data respectively. * csv-dump.scm (assoc-set, parse-raw-table, parse-aggregate-table): New functions. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net> Munyoki Kilyungi
2022-06-24Try uploading twice into virtuoso....* load-rdf.scm (put-graph): Accept retry? argument, and retry if it is #t. (main): Call put-graph with a #t retry? argument. Arun Isaac
2022-06-24Delete vertical tab character in publication abstracts....* dump.scm (dump-publication): Delete vertical tab character in abstracts. Arun Isaac
2022-06-23Add gitignore....* .gitignore: New file. Arun Isaac
2022-06-23Dump groups....* dump.scm (dump-groups): New dump. (main): Call dump-groups. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net> BonfaceKilz
2022-06-23Dump case-attributes....* dump.scm (dump-case-attributes): New dump. (main): Call dump-case-attributes. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net> BonfaceKilz
2022-06-23Remove "." if it occurs at the end of a turtle identifier....A "." at the end of a turtle identifier---for example "gn:caseAttribute_ethn."---generates an error when trying to validate the generated RDF. * dump.scm (string->identifier): Remove trailing "." if it occurs in the identifier. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net> BonfaceKilz
2022-05-05Document source compilation....* README.md (Using): Document source compilation. Arun Isaac
2022-05-05Makefile: Disable auto-compilation while compiling....* Makefile (%.go): Set GUILE_AUTO_COMPILE to 0. Arun Isaac
2022-05-05Compile scheme sources....* Makefile (GUILD, top_level_module_dir, sources, objects): New variables. (all, %.go, clean): New targets. * pre-inst-env: Use built object files. Arun Isaac
2022-05-05manifest: Add gnu-make....* manifest.scm: Import gnu-make from (gnu packages base). Add gnu-make to manifest. Arun Isaac
2022-05-05Validate dumped RDF using rapper....* manifest.scm: Import raptor2 from (gnu packages rdf). Add raptor2 to manifest. * README.md (Using): Document validation using rapper. Arun Isaac
2022-05-05README: Advertise continuous integration build artifacts....* README.md (Using): Advertise continuous integration build artifacts. Arun Isaac
2022-05-05README: Document loading RDF and visualizing schema....* README.md (Using): Document loading RDF and visualizing schema. Arun Isaac
2022-05-05Prefix SQL connection parameters with sql-....This differentiates it from virtuoso and SPARQL connection parameters. * dump.scm (call-with-genenetwork-database, dump-data-table): Prefix SQL connection parameters with sql-. * README.md (Using): Update documentation of SQL connection parameters. Arun Isaac
2022-05-05README: Replace org mode with markdown....Markdown is a simpler format and easier to render to the web. In particular, this change is prompted by Gitea not handling image links correctly. * README.org: Replace with ... * README.md: ... this. Arun Isaac
2022-05-05README: Link to genenetwork.org CI....* README.org: Link to genenetwork.org CI instead of systemreboot.net CI. Arun Isaac
generated by cgit v1.2.3 (git 2.46.2) at 2025-01-27 17:35:52 +0000