summaryrefslogtreecommitdiff
path: root/topics/xapian/xapian-scalability.gmi
diff options
context:
space:
mode:
authorPjotr Prins2023-12-03 09:39:57 -0600
committerPjotr Prins2023-12-03 09:39:57 -0600
commitfe2d644507548dcbaaf8d675d2e5c96795101d70 (patch)
tree1d5c0a0642bdc20bafe9f2d9cc1aab6e22e12281 /topics/xapian/xapian-scalability.gmi
parent064af73a670617c76775f8f94f74e3d5d611d18e (diff)
downloadgn-gemtext-fe2d644507548dcbaaf8d675d2e5c96795101d70.tar.gz
Move xapian files
Diffstat (limited to 'topics/xapian/xapian-scalability.gmi')
-rw-r--r--topics/xapian/xapian-scalability.gmi17
1 files changed, 17 insertions, 0 deletions
diff --git a/topics/xapian/xapian-scalability.gmi b/topics/xapian/xapian-scalability.gmi
new file mode 100644
index 0000000..cfc4e46
--- /dev/null
+++ b/topics/xapian/xapian-scalability.gmi
@@ -0,0 +1,17 @@
+# Xapian scalability
+
+As the index grows larger, Xapian takes longer to insert new documents. Shown below is the time (in seconds) taken to build indices of various sizes (in number of documents).
+
+* 10k: 4.45
+* 20k: 9.48
+* 40k: 20.40
+* 80k: 41.70
+* 160k: 81.63
+* 320k: 159.88
+* 640k: 318.84
+* 1280k: 651.47
+* 2560k: 1357.73
+
+Notice that it takes 305x, not 256x, more time to build the 2560k index than it takes to build the 10k index. In terms of time, the 10k index takes on average 0.45 ms per document while the 2560k index takes on average 0.53 ms per document. We show this graphically below.
+
+=> xapian-index-building-scalability.svg