Docker image built to run code, all evals run using R2RHEADmaster

1 files changed, 172 insertions, 0 deletions

diff --git a/gnqa/paper2_eval/data/human-questions.json b/gnqa/paper2_eval/data/human-questions.json
new file mode 100644
index 0000000..4142e5b
--- /dev/null
+++ b/gnqa/paper2_eval/data/human-questions.json
@@ -0,0 +1,172 @@
+[
+    {
+        "level": "domainexpert",
+        "domain": "gn",
+        "query": [
+            "What are the potential benefits and risk associated with gene editing technologies like CRISPRR-Cas9?",
+            "How does epigenetics inluence gene expression without changing the underlying DNA sequence?",
+            "Describe the role of mitochondrial DNA in heredity and how it differs from nuclear DNA.",
+            "What are the ethical considerations surrounding prenatal genetic testing and the selective termination of pregnancies based on genetic factors?",
+            "Create a how-to guide for genetic sequencing.",
+
+            "Which genes give a predisposition to developing T1D?",
+            "What is ensembl",
+            "Which database can I use for genetic, genomics, phenotype, and disease-related data generated from rat research?",
+            "What is RGD?",
+            "What resources can I use to do pathway analyses?",
+
+            "Once a sperm combines with an egg, what determines how traits are passed onto the resulting lifeform?",
+            "Why is genetic tracing matrilineal rather than patrilineal?",
+            "Explain the process of DNA replication and how it ensures accurate copying of genetic information during cell division.",
+            "What are the potential benefits and risks associated with gene editing technologies like CRISPR-Cas9?",
+            "How does one tell the difference between X and Y DNA, with repsect to DNA tracing and determining QTLs?",
+
+
+            "For text and biological resources, do you mean add some books (on biology stuff) or/and web resources (as ensembl) on your system?",
+            "what is ensembl?",
+            "What is the difference between QTL mapping and GWAS?",
+            "How do I determine which gene in my QTL is causal for the trait?",
+            "Why do males have two Y chromosomes and females only one?",
+            
+            "How does one tell the difference between X and Y DNA, with respect to DNA tracing and determining QTLs",
+            "Once a sperm combines with an egg, what determines how traits are  passed onto the resulting lifeform?",
+            "How can I add a new species to the GeneNetwork database?",
+            "which genes are typically associated with diabetes in QTL analyses?",
+            "In which diseases is the gene TCF7L2 involved?",
+            
+            "Once a sperm combines with an egg, what determines how traits are   passed onto the resulting lifeform?",
+            "Can you explain what a ribosomal binding site at a high level and make it accessable to a non-expert?",
+            "Once a sperm combines with an egg, what determines how traits are   passed onto the resulting lifeform?",
+            "Can you explain the difference between sequencing with short reads vs long reads? Please make you answer accessible to a non-expert.",
+            "Can you explain why using a pangenome-based reference might be more   useful than simply using a single linear reference? Please make you   answer accessible to a non-expert.",
+
+            "Is all genetic regulation done through DNA (e.g., prompters,   repressors, activators) or are there other forms of genetic regulation?   Please make you answer accessible to a non-expert.",
+            "What are the different relationship between traits?",
+            "Can landscape of QTL and GWAS hits be used to find relationships between traits?"
+        ]
+    },
+    {
+        "level": "domainexpert",
+        "domain": "diabetes",
+        "query": [
+            "How is gene expression in the liver affected by diabetes?",
+            "Is any of the genes SH2B3, IFIH1 or ERBB3  related to diabetes?",
+            "nutrition is a factor for diabetes. how can genomics be use to better understand nutritional factors of diabetes",
+            "nutrition is a factor for diabetes. construct an abstract about how can genomics be use to better understand nutritional factors of diabetes",
+            "Is the gene TCF7L2 involved in diabetes?",
+
+            "Is any of the genes SH2B3, IFIH1 or ERBB3 related to diabetes?",
+            "How can I use genenetwork to find genes related with diabetes in humans?",
+            "How can I use the GeneNetwork tool to find genes related with diabetes in humans?",
+            "what are confounding factors in diabetes?",
+            "How is the immune system related to diabetes?",
+            
+            "What are the genomic variants associated with immune system components and diabetes?",
+            "What is the role of the immune system in the metabolomics of diabetes and associated conditions?",
+            "Can the landscape of QTL and GWAS hits be used to dissect the role of immune system in diabetes and complications?"
+
+        ]
+    },
+    {
+        "level": "domainexpert",
+        "domain": "aging",
+        "query": [
+            "What is the significance of the length of telomeres?",
+            "Which mouse genes have been associated with longevity?",
+            "what genetic factor are associated with aging",
+            "which genes are typically associated with early aging?",
+            "How do I generate a linkage or association mapping study in mice to understand aging?",
+            "is there a specific genetic variation that can cause someone to live longer? please make your answer accessible to a non-expert"
+        ]
+    },
+    {
+        "level": "citizenscientist",
+        "domain": "gn",
+        "query": [
+            "What is the most cited environmental factor for the onset of asthma?",
+            "How would one extract the DNA, from say, flora or fauna?","genetics",
+            "what is bioinformatics",
+            "Explain the process of finding a genetic marker followed by a quantitative trait loci.",
+            
+            "What about recombination in human centromeres?",
+            "How does recombination work in human centromeres?",
+            "What about recombination in the human genome?",
+            "Create a how to guide for genetic sequencing",
+            "What is the significance of the length of telomeres? ",
+            
+            "Once a sperm combines with an egg, what determines how traits are passed on to the resulting lifeform? ",
+            "Why is genetic tracing matrilineal rather than patrilineal? ",
+            "How does one tell the difference between X and Y DNA, with respect to DNA tracing and determining QTLs?",
+            "what type of dataset is useful for qtl mapping analysis in genenetwork2?",
+            "what are the bioinformatics tools for QTLs analysis?",
+            
+            "what are the statistical approaches for qtls analysis?",
+            "Create a how-to guide for GWAS analysis?",
+            "Create a how-to guide for genetic sequencing",
+            "Create a how-to guide for genetic sequencing.",
+            "What is the significance of the length of telomeres?",
+            
+            "Create a how-to guide for genetic sequencing",
+            "Create a guide for genetic sequencing",
+            "Define dyslipidemia.",
+            "What is cytochrome?",
+            "How does one tell the difference between X and Y DNA, with respect  to DNA tracing and determining QTLs?",
+            
+            "how does environment influence fertilisation",
+            "how does diet impact someone's height",
+            "which animal has the same number of chromosomes as human",
+            "what ensures brains work",
+            "how do our brains maintain emotions",
+            
+            "what hormones do our brains release during stressful experiences?",
+            "what is the use of corticosterone?"
+        ]
+    },
+    {
+        "level": "citizenscientist",
+        "domain": "diabetes",
+        "query": [
+            "What are the genetic bases for the varying efficacy of diabetes treatments among individuals?",
+            "Explain Protective Genetic Factors Against Diabetes in Elderly Populations",
+            "Explain Effect of Lifestyle Modifications on Aging-Associated Diabetes Risk",
+            "Explain The Role of Longevity Genes in Protecting Against Diabetes",
+            "What are the types of diabetes",
+            
+            "How many types of diabetes exist?",
+            "Is there a direct association between aging and susceptibility to having diabetes?",
+            "How does genetics influence the emergency of diabetes?",
+            "what genes are associated with diabetes?",
+            "What causes diabetes?",
+            
+            "Does cycling reduce risk of diabetes?",
+            "How can GeneNetwork assist in identifying genetic factors involved in diabetes?",
+            "What specific tools within GeneNetwork are most useful for diabetes research, and how are they applied?",
+            "What role does insulin play in the regulation of blood glucose levels?",
+            "How does aging affect the risk of developing type 2 diabetes?",
+            "Can lifestyle changes reverse type 2 diabetes?"
+
+        ]
+    },
+    {
+        "level": "citizenscientist",
+        "domain": "aging",
+        "query": [
+            "List as many studies as you can that include rapamycin.",
+            "Why is it so diffuclut to map gene loci that control aging in humans?",
+            "What is apoptosis?",
+            "which genes are involved in the aging process",
+            "what causes the aging process",
+            
+            "which genes are involved in aging",
+            "what genes are involved in  the aging process",
+            "Describe the genotypes related to Alzheimers and dementia which have commonalities with those for aging.",
+            "Describe the genotypes related to Alzheimer's and dementia which have commonalities with those for aging.",
+            "What genetic factors influence aging in humans?",
+            
+            "what genes are associated with aging?",
+            "Which genes are associated with aging in human",
+            "What is GeneNetwork and how does it relate to aging research?"
+
+        ]
+    }
+]
\ No newline at end of file