<feed xmlns='http://www.w3.org/2005/Atom'>
<title>genenetwork3/scripts/index-genenetwork, branch migrate-to-python3.10</title>
<subtitle>GeneNetwork3 REST API for data science and machine learning
</subtitle>
<id>http://git.genenetwork.org/genenetwork3/atom?h=migrate-to-python3.10</id>
<link rel='self' href='http://git.genenetwork.org/genenetwork3/atom?h=migrate-to-python3.10'/>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/'/>
<updated>2023-05-31T19:28:46+00:00</updated>
<entry>
<title>scripts: Write table checksums into index.</title>
<updated>2023-05-31T19:28:46+00:00</updated>
<author>
<name>Arun Isaac</name>
</author>
<published>2023-05-31T18:23:17+00:00</published>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/commit/?id=78d641b1490b8b0d2b4a5437d6af90742f3011f8'/>
<id>urn:sha1:78d641b1490b8b0d2b4a5437d6af90742f3011f8</id>
<content type='text'>
* scripts/index-genenetwork (main): Write table checksums into index.
</content>
</entry>
<entry>
<title>scripts: Introduce SQLTableClause.</title>
<updated>2023-05-31T18:21:14+00:00</updated>
<author>
<name>Arun Isaac</name>
</author>
<published>2023-05-31T18:21:14+00:00</published>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/commit/?id=400cc9d9c5fa0f1db92679e7ea8d936272029e14'/>
<id>urn:sha1:400cc9d9c5fa0f1db92679e7ea8d936272029e14</id>
<content type='text'>
* scripts/index-genenetwork (SQLTableClause): New variable.
(genes_query, phenotypes_query): Express tables using SQLTableClause.
(serialize_sql): Serialize SQLTableClause.
</content>
</entry>
<entry>
<title>scripts: Fold long lines.</title>
<updated>2023-05-31T14:21:30+00:00</updated>
<author>
<name>Arun Isaac</name>
</author>
<published>2023-05-31T14:21:30+00:00</published>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/commit/?id=082e169ca6676b61935604756c0c7c63e19eeb4a'/>
<id>urn:sha1:082e169ca6676b61935604756c0c7c63e19eeb4a</id>
<content type='text'>
* scripts/index-genenetwork (write_document, index_query): Fold long lines.
</content>
</entry>
<entry>
<title>scripts: Ensure only one indexing job may run at a time.</title>
<updated>2023-05-31T14:19:13+00:00</updated>
<author>
<name>Arun Isaac</name>
</author>
<published>2023-05-31T14:19:13+00:00</published>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/commit/?id=7855758c7f17c32cad3c73f5a5677fb87146e32a'/>
<id>urn:sha1:7855758c7f17c32cad3c73f5a5677fb87146e32a</id>
<content type='text'>
* scripts/index-genenetwork (main): Ensure no other indexing job is running.
</content>
</entry>
<entry>
<title>Make directory at "path" and all intermediate ones.</title>
<updated>2023-05-22T07:20:57+00:00</updated>
<author>
<name>Frederick Muriuki Muriithi</name>
</author>
<published>2023-05-22T07:19:42+00:00</published>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/commit/?id=cb52df1c320463674938462a68e0a3be4279473b'/>
<id>urn:sha1:cb52df1c320463674938462a68e0a3be4279473b</id>
<content type='text'>
Make the directory at the given path, and any intermediate ones to avoid
errors in the indexing code when the directory, or its parent(s) do not exist.
</content>
</entry>
<entry>
<title>Enable use of `database_connection` in scripts without current_app</title>
<updated>2023-04-05T11:51:04+00:00</updated>
<author>
<name>Frederick Muriuki Muriithi</name>
</author>
<published>2023-04-04T07:07:03+00:00</published>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/commit/?id=3d873435f0d464864d4d691d6be4db40931fac05'/>
<id>urn:sha1:3d873435f0d464864d4d691d6be4db40931fac05</id>
<content type='text'>
There is need to run external scripts using the same configurations as the
application but without the need to couple the script to the application.

In this case, we provide the needed configuration directly in the CLI, and
modify the existing `gn3.db_utils.database_connection` function to allow it to
work coupled to the app or otherwise.
</content>
</entry>
<entry>
<title>scripts: Fallback to 1 worker when indexing.</title>
<updated>2023-02-13T17:36:09+00:00</updated>
<author>
<name>Arun Isaac</name>
</author>
<published>2023-02-13T17:35:13+00:00</published>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/commit/?id=283e7f08701ed80cdfeb8773df38c0c30227a10c'/>
<id>urn:sha1:283e7f08701ed80cdfeb8773df38c0c30227a10c</id>
<content type='text'>
* scripts/index-genenetwork (worker_queue): Set default number of workers to 1
if the number of CPUs cannot be determined.
</content>
</entry>
<entry>
<title>scripts: Type hint xapian indexing script.</title>
<updated>2023-02-13T17:36:09+00:00</updated>
<author>
<name>Arun Isaac</name>
</author>
<published>2023-02-13T17:33:27+00:00</published>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/commit/?id=152d0fb36b76b7c68d8202ba3665617bad3e684b'/>
<id>urn:sha1:152d0fb36b76b7c68d8202ba3665617bad3e684b</id>
<content type='text'>
* scripts/index-genenetwork: Import Callable, Generator, Iterable and List
from typing. Type hint all functions.
</content>
</entry>
<entry>
<title>Add xapian indexing script.</title>
<updated>2022-10-18T12:15:33+00:00</updated>
<author>
<name>Arun Isaac</name>
</author>
<published>2022-10-18T09:10:47+00:00</published>
<link rel='alternate' type='text/html' href='http://git.genenetwork.org/genenetwork3/commit/?id=06da0390a1de5d0aa8eb6d7a0ed3120e350f8a0b'/>
<id>urn:sha1:06da0390a1de5d0aa8eb6d7a0ed3120e350f8a0b</id>
<content type='text'>
* scripts/index-genenetwork: New file.
* setup.py (install_requires): Add click, pymonad and xapian-bindings.
(scripts): Add scripts/index-genenetwork.
</content>
</entry>
</feed>
