aboutsummaryrefslogtreecommitdiff
path: root/gnqa/paper1_eval/src/data/responses/general/answer_relevancy.json
diff options
context:
space:
mode:
authorSoloDShelby2024-07-19 14:41:40 +0300
committerSoloDShelby2024-07-19 14:41:40 +0300
commit3fa31b50af2861382fbe2c76406f5a04c3fefc93 (patch)
tree34d581648b0e0d3fc8dbe6577752a4fd433a3258 /gnqa/paper1_eval/src/data/responses/general/answer_relevancy.json
parent74616897e30c7daafe5e74d34073466464921316 (diff)
downloadgn-ai-3fa31b50af2861382fbe2c76406f5a04c3fefc93.tar.gz
Evaluation code for paper 1
Diffstat (limited to 'gnqa/paper1_eval/src/data/responses/general/answer_relevancy.json')
-rw-r--r--gnqa/paper1_eval/src/data/responses/general/answer_relevancy.json7
1 files changed, 7 insertions, 0 deletions
diff --git a/gnqa/paper1_eval/src/data/responses/general/answer_relevancy.json b/gnqa/paper1_eval/src/data/responses/general/answer_relevancy.json
new file mode 100644
index 0000000..11a09d1
--- /dev/null
+++ b/gnqa/paper1_eval/src/data/responses/general/answer_relevancy.json
@@ -0,0 +1,7 @@
+A1: Air pollution is the most cited environmental factor for the onset of asthma.
+
+The given answer is: "Air pollution is the most cited environmental factor for the onset of asthma."
+
+Question: What is the most cited environmental factor for the onset of asthma?
+
+The answer is committal as it provides a specific and direct response to the question. Therefore, the noncommittal value is 0.