blob: 3b9e185be140b6a644b4e55f648792c405d819f9 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
|
# Handling Resource Links in ProbeSet Page
## Tags
* assigned: bonfacem
* priority: high
* type: RDF
* keywords: virtuoso
## Description:
During the finalization of the UI for endpoints, specifically the probeset page, modifications were made to streamline the ProbeSet RDF transform. Unnecessary metadata was removed to reduce the transformed data. Most of the metadata on the probeset page is utilized for constructing resources. An example of a probeset page is:
=> https://genenetwork.org/show_trait?trait_id=1435395_s_at&dataset=HC_M2_0606_P Trait Data and Analysis for 1435395_s_at
Under the "Resource Links" section on this page, there's a specific URL:
=> https://genemania.org/search/mus-musculus/Atp5j2
Attempting to prefix this resource link as "genemania:mus-musculus/Atp5j2" is not valid in Turtle format.
To circumvent this issue, a workaround will be implemented:
```turtle
gn:probeset1435395_s_at gnt:hasGeneManiaResource <https://genemania.org/search/mus-musculus/Atp5j2> .
<https://genemania.org/search/mus-musculus/Atp5j2> rdf:type gnc:ResourceLink .
```
The straightforward approach would be to construct this structure in the front-end. However, the problem lies in the fact that these resource links are inferred, making it challenging to discern their connection within GN without visiting the website. Therefore, it's preferable to store this information in RDF despite the ease of constructing it in the front-end.
One link that's difficult to construct is the UCSC link:
=> http://genome.cse.ucsc.edu/cgi-bin/hgTracks?db=mm10&hgg_gene=NM_020582&hgg_chrom=chr5&hgg_start=145183705&hgg_end=145191592
To construct the above link, we need to have the ProbeSet.refseq_transcriptid and the GeneList.TxStart/GeneList.TxEnd. However, doing a join between these 2 tables takes too long and the generated file get's too big.
### Resolution
Transforming ProbeSet metadata takes long. The exact command:
```shell
time guix shell guile-dbi \
guile-hashing -m manifest.scm \
-- ./pre-inst-env \
./examples/probeset.scm --settings \
conn.scm --output \
/export/data/genenetwork-virtuoso/probeset-metadata.ttl \
--documentation ./docs/probeset-metadata.md
```
The aforementioned command takes:
* real: 89m1.715s
* user: 175m47.684s
* sys: 6m15.076s
A second try:
* real: 87m45.751s
* user: 179m40.676s
* sys: 7m13.456s
The file-size of the transformed metadata is 6.0G which is to be expected.
Optimisations---perhaps using guile-fibers---can be considered later.
* closed
|
