From fe2d644507548dcbaaf8d675d2e5c96795101d70 Mon Sep 17 00:00:00 2001 From: Pjotr Prins Date: Sun, 3 Dec 2023 09:39:57 -0600 Subject: Move xapian files --- topics/xapian/xapian-scalability.gmi | 17 +++++++++++++++++ 1 file changed, 17 insertions(+) create mode 100644 topics/xapian/xapian-scalability.gmi (limited to 'topics/xapian/xapian-scalability.gmi') diff --git a/topics/xapian/xapian-scalability.gmi b/topics/xapian/xapian-scalability.gmi new file mode 100644 index 0000000..cfc4e46 --- /dev/null +++ b/topics/xapian/xapian-scalability.gmi @@ -0,0 +1,17 @@ +# Xapian scalability + +As the index grows larger, Xapian takes longer to insert new documents. Shown below is the time (in seconds) taken to build indices of various sizes (in number of documents). + +* 10k: 4.45 +* 20k: 9.48 +* 40k: 20.40 +* 80k: 41.70 +* 160k: 81.63 +* 320k: 159.88 +* 640k: 318.84 +* 1280k: 651.47 +* 2560k: 1357.73 + +Notice that it takes 305x, not 256x, more time to build the 2560k index than it takes to build the 10k index. In terms of time, the 10k index takes on average 0.45 ms per document while the 2560k index takes on average 0.53 ms per document. We show this graphically below. + +=> xapian-index-building-scalability.svg -- cgit v1.2.3