aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2022-10-21Authenticate when deleting graph from virtuoso.Arun Isaac
* load-rdf.scm (delete-graph): Accept password argument. (main): Call delete-graph with password.
2022-08-20Add gn:traitId and gn:publicationId.Munyoki Kilyungi
In GeneNetwork, a phenonytpe is currently identified by it's ID (primary key of the table from MariaDB). The only way to relate it to a publication is through a publication ID. This is important because there are some publications with a NULL value for "pubmed ID" and as such without the publication ID, some data is lost as there's no way to point to publication with a NULL "pubmed ID." * dump.scm (dump-publish-xref): Define gn:traitId and gn:publicationId. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net>
2022-08-02Add new functions to read CSV files in a flexible way.Munyoki Kilyungi
We add new functions---parse-raw-table and parse-aggregate-table---to parse raw ungrouped data and grouped data respectively. * csv-dump.scm (assoc-set, parse-raw-table, parse-aggregate-table): New functions. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net>
2022-06-24Try uploading twice into virtuoso.Arun Isaac
* load-rdf.scm (put-graph): Accept retry? argument, and retry if it is #t. (main): Call put-graph with a #t retry? argument.
2022-06-24Delete vertical tab character in publication abstracts.Arun Isaac
* dump.scm (dump-publication): Delete vertical tab character in abstracts.
2022-06-23Add gitignore.Arun Isaac
* .gitignore: New file.
2022-06-23Dump groups.BonfaceKilz
* dump.scm (dump-groups): New dump. (main): Call dump-groups. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net>
2022-06-23Dump case-attributes.BonfaceKilz
* dump.scm (dump-case-attributes): New dump. (main): Call dump-case-attributes. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net>
2022-06-23Remove "." if it occurs at the end of a turtle identifier.BonfaceKilz
A "." at the end of a turtle identifier---for example "gn:caseAttribute_ethn."---generates an error when trying to validate the generated RDF. * dump.scm (string->identifier): Remove trailing "." if it occurs in the identifier. Signed-off-by: Arun Isaac <arunisaac@systemreboot.net>
2022-05-05Document source compilation.Arun Isaac
* README.md (Using): Document source compilation.
2022-05-05Makefile: Disable auto-compilation while compiling.Arun Isaac
* Makefile (%.go): Set GUILE_AUTO_COMPILE to 0.
2022-05-05Compile scheme sources.Arun Isaac
* Makefile (GUILD, top_level_module_dir, sources, objects): New variables. (all, %.go, clean): New targets. * pre-inst-env: Use built object files.
2022-05-05manifest: Add gnu-make.Arun Isaac
* manifest.scm: Import gnu-make from (gnu packages base). Add gnu-make to manifest.
2022-05-05Validate dumped RDF using rapper.Arun Isaac
* manifest.scm: Import raptor2 from (gnu packages rdf). Add raptor2 to manifest. * README.md (Using): Document validation using rapper.
2022-05-05README: Advertise continuous integration build artifacts.Arun Isaac
* README.md (Using): Advertise continuous integration build artifacts.
2022-05-05README: Document loading RDF and visualizing schema.Arun Isaac
* README.md (Using): Document loading RDF and visualizing schema.
2022-05-05Prefix SQL connection parameters with sql-.Arun Isaac
This differentiates it from virtuoso and SPARQL connection parameters. * dump.scm (call-with-genenetwork-database, dump-data-table): Prefix SQL connection parameters with sql-. * README.md (Using): Update documentation of SQL connection parameters.
2022-05-05README: Replace org mode with markdown.Arun Isaac
Markdown is a simpler format and easier to render to the web. In particular, this change is prompted by Gitea not handling image links correctly. * README.org: Replace with ... * README.md: ... this.
2022-05-05README: Link to genenetwork.org CI.Arun Isaac
* README.org: Link to genenetwork.org CI instead of systemreboot.net CI.
2022-05-05README: Add CI badges.Arun Isaac
* README.org: Add CI badges.
2022-05-04Read SPARQL connection settings from file.Arun Isaac
* visualize-schema.scm (%sparql-host, %sparql-port): New parameters. (sparql-query-records): Use %sparql-host and %sparql-port parameters. (main): Accept connection settings file as argument, read it, and parameterize %sparql-host and %sparql-port. Pass command-line arguments to main.
2022-05-04Import guile-hashing in manifest.Arun Isaac
This is a follow-up from commit baa9b54f1eb232ed891beaf8a24c3d0d058fbd31 where this change was missed out. * manifest.scm: Import guile-hashing from (gnu packages guile-xyz).
2022-05-04Add script to load RDF into virtuoso.Arun Isaac
* load-rdf.scm: New file. * manifest.scm: Import virtuoso-ose from (gnu packages databases). Add virtuoso-ose to manifest.
2022-05-04Special case investigator ID for "Yohan Bossé".Arun Isaac
* dump.scm (investigator-attributes->id): Add special case for investigator "Yohan Bossé".
2022-04-15pre-inst-env: Rename prepend-path-env! to prepend-path-environment!.Arun Isaac
* pre-inst-env (prepend-path-env!): Rename to prepend-path-environment!. Adjust invocations of prepend-path-env!.
2022-03-10Ignore 0th command-line argument.Arun Isaac
* dump.scm (%connection-settings): Use 1th command-line argument. (%dump-directory): Use 2th command-line argument.
2022-03-10Accept connection parameters and dump directory as arguments.Arun Isaac
* dump.scm: Import (rnrs programs). (%connection-settings): New variable. (call-with-database): Use %connection-settings. (%database-name): Delete variable. (%dump-directory): Set from command-line arguments. (dump-data-table): Use %connection-settings instead of %database-name. * README.org (Using): Add command-line arguments to usage instructions.
2022-03-10Rename the delete verb of map-alist to remove.Arun Isaac
The delete verb of map-alist somehow interacts with the delete function from (srfi srfi-1), and I'm not able to figure out how. It is simpler to just rename the delete verb to remove. * dump/utils.scm: Do not rename the delete function from (srfi srfi-1). (map-alist): Rename the delete verb to remove. * tests.scm ("map-alist docstring example"): Update test.
2022-03-10Work around broken upstream guile-sparql package.Arun Isaac
* manifest.scm: Import guile-sparql with guix: prefix. (guile-sparql): New variable.
2022-03-10Remove guix: prefix from guile-libyaml.Arun Isaac
This reverses an accidental commit of work in progress code. * manifest.scm: Remove guix: prefix from guile-libyaml.
2022-03-10Use run64 to run tests.Arun Isaac
* manifest.scm: Import (guix build-system gnu) and (guix licenses). (run64): New variable. Add run64 to manifest. * Makefile (GUILE): Delete variable. (RUN64): New variable. (check): Use run64 instead of guile to run tests.
2022-03-10Add Makefile.Arun Isaac
* Makefile: New file.
2022-03-10Allow tabs in Makefiles.Arun Isaac
* .dir-locals.el (makefile-gmake-mode): Set indent-tabs-mode to t.
2022-03-09Rename guix.scm to manifest.scm.Arun Isaac
We only have a manifest, not a package definition. So, rename it as such, making `guix shell' invocations briefer. * guix.scm: Rename to manifest.scm. In documentation comments, make `guix shell' implicitly pick up the manifest file. * README.org (Using): Make `guix shell' implicitly pick up the manifest file.
2022-01-04Eval macro helper functions at macro expansion time.Arun Isaac
If these macro helper functions are not evaluated at macro expansion time, the dependent macros will fail to compile. * dump.scm (string->identifier, field->key, field->assoc-ref, collect-fields, find-clause, remove-namespace, column-id, dump-id): Eval at macro expansion time.
2021-12-27BUGS: Add "Dump table and field annotations to RDF" bug.Arun Isaac
* BUGS.org (Dump table and field annotations to RDF): New bug.
2021-12-24Make visualize-schema executable.Arun Isaac
* visualize-schema.scm: Add shebang and grant execution permissions.
2021-12-24README: Execute dump.scm directly without invoking guile.Arun Isaac
* README.org (Using): Execute dump.scm directly without explicitly invoking guile.
2021-12-24Add pre-inst-env.Arun Isaac
* pre-inst-env: New file.
2021-12-24Do not add to load path in script.Arun Isaac
* dump.scm: Do not add to load path.
2021-12-24README: Add Using section.Arun Isaac
* README.org (Using): New section.
2021-12-24README: Add Contributing section.Arun Isaac
* README.org (Contributing): New section.
2021-12-24BUGS: Add table size estimates bug.Arun Isaac
* BUGS.org (Fix table size estimates): New bug.
2021-12-24BUGS: Add bug tracker.Arun Isaac
* BUGS.org: New file.
2021-12-24Visualize RDF schema.Arun Isaac
* visualize-schema.scm (literal-node-id, rdf-type-nodes, rdf-literal-nodes, rdf-edges, write-rdf-visualization): New functions. (main): Call write-rdf-visualization.
2021-12-24Wrap SQL visualization code into a function.Arun Isaac
* visualize-schema.scm (write-sql-visualization, main): New functions. Invoke main.
2021-12-24Import functions from (ccwl graphviz).Arun Isaac
* visualize-schema.scm (graph->dot, graph, graph-node, graph-edge, graph-port, html-string): New functions. (sxml->graphviz-html): Use html-string. (foreign-key-graphviz-edges): Use graph-port.
2021-12-24Color code dumped tables and columns.Arun Isaac
* visualize-schema.scm (sxml->graphviz-html): Color code dumped tables and columns.
2021-12-24Fetch entire table schema in single SPARQL query.Arun Isaac
* visualize-schema.scm (tables): Fetch entire table schema in single SPARQL query.
2021-12-24Add TODO note to prefer JSON query results to CSV.Arun Isaac
* visualize-schema.scm (sparql-query-records): Add TODO note to prefer JSON query results to CSV.
generated by cgit v1.2.3 (git 2.44.0) at 2024-11-19 05:59:03 +0000