diff options
| author | Arun Isaac | 2022-10-10 14:08:23 +0530 |
|---|---|---|
| committer | Arun Isaac | 2022-10-10 14:10:25 +0530 |
| commit | 2e2e1b6a472c5453b5cf37cdb463ec1bcb29f446 (patch) | |
| tree | 4c2b07e501fb819e1028a518b772e12fb9bf4312 /topics/xapian-scalability.gmi | |
| parent | bf597c0aa403a92f453c8791178f052459e692bc (diff) | |
| download | gn-gemtext-2e2e1b6a472c5453b5cf37cdb463ec1bcb29f446.tar.gz | |
Comment on xapian scalability.
Diffstat (limited to 'topics/xapian-scalability.gmi')
| -rw-r--r-- | topics/xapian-scalability.gmi | 18 |
1 files changed, 18 insertions, 0 deletions
diff --git a/topics/xapian-scalability.gmi b/topics/xapian-scalability.gmi new file mode 100644 index 0000000..f6eb768 --- /dev/null +++ b/topics/xapian-scalability.gmi @@ -0,0 +1,18 @@ +# Xapian scalability + +As the index grows larger, Xapian takes longer to insert new documents. Shown below is the time (in seconds) taken to build indices of various sizes (in number of documents). + +* 10k: 5.0009455639999985 +* 20k: 10.747144626 +* 40k: 21.052039352999998 +* 80k: 42.342509834 +* 160k: 87.152875767 +* 320k: 176.353327516 +* 640k: 353.9213599920001 +* 1280k: 727.506412363 +* 2560k: 1494.2583154410001 +* 5120k: 3037.993937756 + +Notice that it takes 607x, not 512x, more time to build the 5120k index than it takes to build the 10k index. In terms of time, the 10k index takes on average 0.5 ms per document while the 5120k index takes on average 0.59 ms per document. We show this graphically below. + +=> xapian-index-building-scalability.svg |