summary refs log tree commit diff
path: root/topics/meetings/gn-kilifi-2025-standup.gmi
blob: c20e8475a5bd89e49046c48e7438b0442b85787c (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
# Stand-up Notes

## 25-8-2025
### Felix
* Completed first draft of the abstract
* HS genotyping; polishing founders vcf file:
* - sorting xsome order
* - remove duplicate markers

### Johannnes
* Extending the rag system, make it more of an agent:
* - fixing bugs
* - reduce runtime

### Bonface
* CD went down!
* revert it to last commit
* set it up locally (not very easy)
* coordinate with Fred and Aarun for help

## 27-8-2025
### Felix
* updating the abstract: meeting with Kauthar, for more tips and insight
* HS rats genotyping
* still no significant output

### Bonface
* fixed GN3, GN guile, and GN auth
* reproduce GN2 error, not yet fixed though

### Johannes
* LLM transformer is taking too long to run
* change input documentations to observe results

## 29-8-2025
### Felix
* Still on the abstract
* Errors with hs genotyping script

### Johannes
*  Still on the rag system: experimenting with documents as input

### Bonface
* CD down again, tux02 is the calprit
* Running gn2 outside container in meantime

## 1-9-2025
### Felix
* improving the smoothing scripts for hs: building a snakemake pipeline; redrafting the abstract introductory part

### Bonface
* looked on deployment to fix...,
* install gpu drivers for penguine 2 with alex
* it has gpu drivers tesla k8, but hardware installation is important for the meantime

### Alex
* rqlt2/lmdb runs and rebooted
* dumping bxd phenotype dataset for testing

### Johannes
* no big updates
* literature review on rag systems and how they work

## 3-9-2025
### Felix
* Improved the inferring script
* Abstract on hold first

### Johannes
* fix documents using agents: the issue is parallelization
* reviewing fahamu AI (the python part)

### Bonface
* Gn2 finally runs
* Documenting the progress and steps
* Gn-auth is broken; Fred to solve it
* Updated tesla k8 gpu drivers


### Alex
* Rqtl-wrapper for BXD is done
* focusing on cross-information;lmdb

## 5-9-2025
### Felix
* managed to generate haplotype blocks for hs rats

### Johannes
* RAG experimentation script: balg01, running slow; prepare for msc defense

### Alex
* dumping phenotypes to lmdb

### Bonface
* install drivers on tesla k8
* review Johannes scripts
* fixing gn2
* review alex's patches, {pull requests via emails}

* AOB;
* API tokens for RAG and coding

## 10-9-2025
### Felix
* Managed to run gemma and generate plots for the original hs genotype data and hs smoothed genotype data
* Still working on fine-tuning the statistical metrices to suite the plots

### Bonface
* All the GN machines are up and running, expect GN Auth
* Sent documentations to Pjotr on the progress with troubleshooting GN machines

### Alex
* writing queries to move phenotypes matrices from gn2 db to lmdb

### Johannes
* defense

## 17-9-2025
### Felix
* Completed abstract writing
* Working on generating genotype files for hs in gn2 format

### Bonface
* Gn machines are up and running
* Still some issues with manually restarting the container
* Worked with Alex to set up an external bootable ssd for Johannes

### Alex
* Succeeded dumping phenotypes to lmdb
* Been reading literature around phenotypes in gn2
* Assisted Bonz in setting up external bootable ssd for Johannes

### Johannes
* Managed to get access to bux01 server for the llms work

## 19-09-2025
### Felix
* Finalized HS genotypes/haplotypes

### Bonface
* GN machines are running on CD
* troubleshooting assisted by Aaron

### Johannes
* Experimenting with RAG systems

### Alex
* Writing LMDB scripts to dump phenotypes to LMDB from the common gn DB

## [Review] MONTH OCTOBER, 2025
*** Metric wise, plans and goals to achieve

### Bonface
Thoughts: Good start after relocation.

* CD/CI: Make sure that tests/infra is super stable
* Look at suggested forge/guix-bioinformatics upgrades that affect prod
* Support work for GNQA: sane gn-qna(fahamu)/AI deploys; Review Johannes' work; Help with tuning models; play catch up (cover up knowledge gap); figure out how to compare the different models.
* Follow up on my phd

### Alex
Thoughts: very productive

* Rqtl2 lmdb adapter running on production; depends on traction with Rqtl2 upstream by karl Browman to gn-bioinformatics
* Collaborate with Felix on his scripts

### Johannes

Thoughts: Not very productive, barely, looking forward for more improvement

* Experimenting on the qtl data with the AI system being currently built; also in need of optimization
* Comparing LLMs/GNQA agents; getting assistance from Shelby's work

### Felix
* HS genotypes to be fully supported in GN2
* Poster presentation
* PhD: ML objective (ML fundamentals); Complete 1st manuscript draft; Process my student pass