summaryrefslogtreecommitdiff
path: root/topics/xapian-scalability.gmi
blob: f6eb768cbed6bb76b0b43350dccbf08794376d14 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
# Xapian scalability

As the index grows larger, Xapian takes longer to insert new documents. Shown below is the time (in seconds) taken to build indices of various sizes (in number of documents).

* 10k: 5.0009455639999985
* 20k: 10.747144626
* 40k: 21.052039352999998
* 80k: 42.342509834
* 160k: 87.152875767
* 320k: 176.353327516
* 640k: 353.9213599920001
* 1280k: 727.506412363
* 2560k: 1494.2583154410001
* 5120k: 3037.993937756

Notice that it takes 607x, not 512x, more time to build the 5120k index than it takes to build the 10k index. In terms of time, the 10k index takes on average 0.5 ms per document while the 5120k index takes on average 0.59 ms per document. We show this graphically below.

=> xapian-index-building-scalability.svg