diff options
author | Arun Isaac | 2022-10-11 12:04:48 +0530 |
---|---|---|
committer | Arun Isaac | 2022-10-11 12:04:48 +0530 |
commit | a513d830c06ead1033057cff08466bf5db900af1 (patch) | |
tree | 6bb22b4cde6d8629647474dcef1a49e649a90c20 /topics | |
parent | cc418b26532d35e7eaa5f5aff092ddffc382b2a0 (diff) | |
download | gn-gemtext-a513d830c06ead1033057cff08466bf5db900af1.tar.gz |
Correct xapian scalability figures for SQL database access.
Earlier, the time estimates included the time taken to retrieve the
documents from the SQL database. This is now removed giving a clearer
picture of xapian scalability.
Diffstat (limited to 'topics')
-rw-r--r-- | topics/xapian-index-building-scalability.svg | 148 | ||||
-rw-r--r-- | topics/xapian-scalability.gmi | 21 |
2 files changed, 81 insertions, 88 deletions
diff --git a/topics/xapian-index-building-scalability.svg b/topics/xapian-index-building-scalability.svg index 5452117..9d525d4 100644 --- a/topics/xapian-index-building-scalability.svg +++ b/topics/xapian-index-building-scalability.svg @@ -46,12 +46,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,422.40 L574.82,422.40 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,422.40 L574.82,422.40 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,422.40 L89.92,422.40 M574.82,422.40 L565.82,422.40 '/> <g transform="translate(72.53,426.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.5</tspan></text> + <path stroke='black' d='M62.92,422.40 L71.92,422.40 M574.82,422.40 L565.82,422.40 '/> <g transform="translate(54.53,426.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.44</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -59,12 +59,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,385.56 L574.82,385.56 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,385.56 L574.82,385.56 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,385.56 L89.92,385.56 M574.82,385.56 L565.82,385.56 '/> <g transform="translate(72.53,389.46)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.51</tspan></text> + <path stroke='black' d='M62.92,385.56 L71.92,385.56 M574.82,385.56 L565.82,385.56 '/> <g transform="translate(54.53,389.46)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.45</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -72,12 +72,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,348.72 L574.82,348.72 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,348.72 L574.82,348.72 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,348.72 L89.92,348.72 M574.82,348.72 L565.82,348.72 '/> <g transform="translate(72.53,352.62)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.52</tspan></text> + <path stroke='black' d='M62.92,348.72 L71.92,348.72 M574.82,348.72 L565.82,348.72 '/> <g transform="translate(54.53,352.62)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.46</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -85,12 +85,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,311.88 L574.82,311.88 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,311.88 L574.82,311.88 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,311.88 L89.92,311.88 M574.82,311.88 L565.82,311.88 '/> <g transform="translate(72.53,315.78)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.53</tspan></text> + <path stroke='black' d='M62.92,311.88 L71.92,311.88 M574.82,311.88 L565.82,311.88 '/> <g transform="translate(54.53,315.78)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.47</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -98,12 +98,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,275.04 L574.82,275.04 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,275.04 L574.82,275.04 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,275.04 L89.92,275.04 M574.82,275.04 L565.82,275.04 '/> <g transform="translate(72.53,278.94)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.54</tspan></text> + <path stroke='black' d='M62.92,275.04 L71.92,275.04 M574.82,275.04 L565.82,275.04 '/> <g transform="translate(54.53,278.94)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.48</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -111,12 +111,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,238.20 L574.82,238.20 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,238.20 L574.82,238.20 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,238.20 L89.92,238.20 M574.82,238.20 L565.82,238.20 '/> <g transform="translate(72.53,242.10)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.55</tspan></text> + <path stroke='black' d='M62.92,238.20 L71.92,238.20 M574.82,238.20 L565.82,238.20 '/> <g transform="translate(54.53,242.10)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.49</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -124,12 +124,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,201.37 L574.82,201.37 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,201.37 L574.82,201.37 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,201.37 L89.92,201.37 M574.82,201.37 L565.82,201.37 '/> <g transform="translate(72.53,205.27)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.56</tspan></text> + <path stroke='black' d='M62.92,201.37 L71.92,201.37 M574.82,201.37 L565.82,201.37 '/> <g transform="translate(54.53,205.27)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.5</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -137,12 +137,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,164.53 L574.82,164.53 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,164.53 L574.82,164.53 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,164.53 L89.92,164.53 M574.82,164.53 L565.82,164.53 '/> <g transform="translate(72.53,168.43)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.57</tspan></text> + <path stroke='black' d='M62.92,164.53 L71.92,164.53 M574.82,164.53 L565.82,164.53 '/> <g transform="translate(54.53,168.43)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.51</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -150,12 +150,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,127.69 L574.82,127.69 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,127.69 L574.82,127.69 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,127.69 L89.92,127.69 M574.82,127.69 L565.82,127.69 '/> <g transform="translate(72.53,131.59)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.58</tspan></text> + <path stroke='black' d='M62.92,127.69 L71.92,127.69 M574.82,127.69 L565.82,127.69 '/> <g transform="translate(54.53,131.59)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.52</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -163,12 +163,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,90.85 L574.82,90.85 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,90.85 L574.82,90.85 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,90.85 L89.92,90.85 M574.82,90.85 L565.82,90.85 '/> <g transform="translate(72.53,94.75)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.59</tspan></text> + <path stroke='black' d='M62.92,90.85 L71.92,90.85 M574.82,90.85 L565.82,90.85 '/> <g transform="translate(54.53,94.75)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.53</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -176,12 +176,12 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,54.01 L574.82,54.01 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,54.01 L574.82,54.01 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,54.01 L89.92,54.01 M574.82,54.01 L565.82,54.01 '/> <g transform="translate(72.53,57.91)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> - <text><tspan font-family="Arial" > 0.6</tspan></text> + <path stroke='black' d='M62.92,54.01 L71.92,54.01 M574.82,54.01 L565.82,54.01 '/> <g transform="translate(54.53,57.91)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="end"> + <text><tspan font-family="Arial" > 0.54</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -189,53 +189,53 @@ <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M80.92,422.40 L80.92,54.01 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M62.92,422.40 L62.92,54.01 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,422.40 L80.92,413.40 M80.92,54.01 L80.92,63.01 '/> <g transform="translate(80.92,444.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> - <text><tspan font-family="Arial" > 10000</tspan></text> + <path stroke='black' d='M62.92,422.40 L62.92,413.40 M62.92,54.01 L62.92,63.01 '/> <g transform="translate(62.92,444.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> + <text><tspan font-family="Arial" >10k</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M130.48,422.40 L130.48,417.90 M130.48,54.01 L130.48,58.51 M159.47,422.40 L159.47,417.90 M159.47,54.01 L159.47,58.51 - M180.04,422.40 L180.04,417.90 M180.04,54.01 L180.04,58.51 M195.99,422.40 L195.99,417.90 M195.99,54.01 L195.99,58.51 - M209.03,422.40 L209.03,417.90 M209.03,54.01 L209.03,58.51 M220.05,422.40 L220.05,417.90 M220.05,54.01 L220.05,58.51 - M229.60,422.40 L229.60,417.90 M229.60,54.01 L229.60,58.51 M238.02,422.40 L238.02,417.90 M238.02,54.01 L238.02,58.51 + <path stroke='black' d='M114.29,422.40 L114.29,417.90 M114.29,54.01 L114.29,58.51 M144.33,422.40 L144.33,417.90 M144.33,54.01 L144.33,58.51 + M165.65,422.40 L165.65,417.90 M165.65,54.01 L165.65,58.51 M182.19,422.40 L182.19,417.90 M182.19,54.01 L182.19,58.51 + M195.70,422.40 L195.70,417.90 M195.70,54.01 L195.70,58.51 M207.12,422.40 L207.12,417.90 M207.12,54.01 L207.12,58.51 + M217.02,422.40 L217.02,417.90 M217.02,54.01 L217.02,58.51 M225.75,422.40 L225.75,417.90 M225.75,54.01 L225.75,58.51 '/></g> <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M245.55,422.40 L245.55,54.01 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M233.55,422.40 L233.55,54.01 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M245.55,422.40 L245.55,413.40 M245.55,54.01 L245.55,63.01 '/> <g transform="translate(245.55,444.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> - <text><tspan font-family="Arial" > 100000</tspan></text> + <path stroke='black' d='M233.55,422.40 L233.55,413.40 M233.55,54.01 L233.55,63.01 '/> <g transform="translate(233.55,444.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> + <text><tspan font-family="Arial" >100k</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M295.11,422.40 L295.11,417.90 M295.11,54.01 L295.11,58.51 M324.10,422.40 L324.10,417.90 M324.10,54.01 L324.10,58.51 - M344.67,422.40 L344.67,417.90 M344.67,54.01 L344.67,58.51 M360.63,422.40 L360.63,417.90 M360.63,54.01 L360.63,58.51 - M373.66,422.40 L373.66,417.90 M373.66,54.01 L373.66,58.51 M384.68,422.40 L384.68,417.90 M384.68,54.01 L384.68,58.51 - M394.23,422.40 L394.23,417.90 M394.23,54.01 L394.23,58.51 M402.65,422.40 L402.65,417.90 M402.65,54.01 L402.65,58.51 + <path stroke='black' d='M284.92,422.40 L284.92,417.90 M284.92,54.01 L284.92,58.51 M314.97,422.40 L314.97,417.90 M314.97,54.01 L314.97,58.51 + M336.28,422.40 L336.28,417.90 M336.28,54.01 L336.28,58.51 M352.82,422.40 L352.82,417.90 M352.82,54.01 L352.82,58.51 + M366.33,422.40 L366.33,417.90 M366.33,54.01 L366.33,58.51 M377.76,422.40 L377.76,417.90 M377.76,54.01 L377.76,58.51 + M387.65,422.40 L387.65,417.90 M387.65,54.01 L387.65,58.51 M396.38,422.40 L396.38,417.90 M396.38,54.01 L396.38,58.51 '/></g> <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="gray" stroke="currentColor" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M410.19,422.40 L410.19,54.01 '/></g> + <path stroke='gray' stroke-dasharray='2,4' class="gridline" d='M404.19,422.40 L404.19,54.01 '/></g> <g fill="none" color="gray" stroke="gray" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M410.19,422.40 L410.19,413.40 M410.19,54.01 L410.19,63.01 '/> <g transform="translate(410.19,444.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> - <text><tspan font-family="Arial" > 1x10</tspan><tspan font-family="Arial" font-size="9.6" dy="-6.00px">6</tspan><tspan font-size="12.0" dy="6.00"></tspan></text> + <path stroke='black' d='M404.19,422.40 L404.19,413.40 M404.19,54.01 L404.19,63.01 '/> <g transform="translate(404.19,444.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> + <text><tspan font-family="Arial" >1M</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M459.75,422.40 L459.75,417.90 M459.75,54.01 L459.75,58.51 M488.74,422.40 L488.74,417.90 M488.74,54.01 L488.74,58.51 - M509.31,422.40 L509.31,417.90 M509.31,54.01 L509.31,58.51 M525.26,422.40 L525.26,417.90 M525.26,54.01 L525.26,58.51 - M538.30,422.40 L538.30,417.90 M538.30,54.01 L538.30,58.51 M549.32,422.40 L549.32,417.90 M549.32,54.01 L549.32,58.51 - M558.87,422.40 L558.87,417.90 M558.87,54.01 L558.87,58.51 M567.29,422.40 L567.29,417.90 M567.29,54.01 L567.29,58.51 + <path stroke='black' d='M455.55,422.40 L455.55,417.90 M455.55,54.01 L455.55,58.51 M485.60,422.40 L485.60,417.90 M485.60,54.01 L485.60,58.51 + M506.92,422.40 L506.92,417.90 M506.92,54.01 L506.92,58.51 M523.45,422.40 L523.45,417.90 M523.45,54.01 L523.45,58.51 + M536.97,422.40 L536.97,417.90 M536.97,54.01 L536.97,58.51 M548.39,422.40 L548.39,417.90 M548.39,54.01 L548.39,58.51 + M558.28,422.40 L558.28,417.90 M558.28,54.01 L558.28,58.51 M567.01,422.40 L567.01,417.90 M567.01,54.01 L567.01,58.51 '/></g> <g fill="none" color="black" stroke="black" stroke-width="0.50" stroke-linecap="butt" stroke-linejoin="miter"> </g> @@ -245,21 +245,16 @@ </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> <path stroke='black' d='M574.82,422.40 L574.82,413.40 M574.82,54.01 L574.82,63.01 '/> <g transform="translate(574.82,444.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> - <text><tspan font-family="Arial" > 1x10</tspan><tspan font-family="Arial" font-size="9.6" dy="-6.00px">7</tspan><tspan font-size="12.0" dy="6.00"></tspan></text> + <text><tspan font-family="Arial" >10M</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,54.01 L80.92,422.40 L574.82,422.40 L574.82,54.01 L80.92,54.01 Z '/></g> -<g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <g transform="translate(19.18,238.21) rotate(270)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> - <text><tspan font-family="Arial" >Time (in ms)</tspan></text> - </g> -</g> + <path stroke='black' d='M62.92,54.01 L62.92,422.40 L574.82,422.40 L574.82,54.01 L62.92,54.01 Z '/></g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <g transform="translate(327.87,471.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> - <text><tspan font-family="Arial" >Index size (in number of documents)</tspan></text> + <g transform="translate(318.87,471.30)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> + <text><tspan font-family="Arial" >Xapian index size (in number of documents)</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -268,17 +263,16 @@ <g fill="none" color="white" stroke="currentColor" stroke-width="2.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="2.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,422.05 L130.48,284.78 L180.04,325.51 L229.60,314.53 L279.16,257.71 L328.72,234.14 L378.28,227.15 L427.84,170.55 - L477.40,114.08 L526.96,78.48 '/> <use xlink:href='#gpPt0' transform='translate(80.92,422.05) scale(9.00)' color='black'/> - <use xlink:href='#gpPt0' transform='translate(130.48,284.78) scale(9.00)' color='black'/> - <use xlink:href='#gpPt0' transform='translate(180.04,325.51) scale(9.00)' color='black'/> - <use xlink:href='#gpPt0' transform='translate(229.60,314.53) scale(9.00)' color='black'/> - <use xlink:href='#gpPt0' transform='translate(279.16,257.71) scale(9.00)' color='black'/> - <use xlink:href='#gpPt0' transform='translate(328.72,234.14) scale(9.00)' color='black'/> - <use xlink:href='#gpPt0' transform='translate(378.28,227.15) scale(9.00)' color='black'/> - <use xlink:href='#gpPt0' transform='translate(427.84,170.55) scale(9.00)' color='black'/> - <use xlink:href='#gpPt0' transform='translate(477.40,114.08) scale(9.00)' color='black'/> - <use xlink:href='#gpPt0' transform='translate(526.96,78.48) scale(9.00)' color='black'/> + <path stroke='black' d='M62.92,403.76 L114.29,297.84 L165.65,164.44 L217.02,122.94 L268.38,163.79 L319.75,202.70 L371.11,208.05 L422.48,168.36 + L473.85,89.51 '/> <use xlink:href='#gpPt0' transform='translate(62.92,403.76) scale(9.00)' color='black'/> + <use xlink:href='#gpPt0' transform='translate(114.29,297.84) scale(9.00)' color='black'/> + <use xlink:href='#gpPt0' transform='translate(165.65,164.44) scale(9.00)' color='black'/> + <use xlink:href='#gpPt0' transform='translate(217.02,122.94) scale(9.00)' color='black'/> + <use xlink:href='#gpPt0' transform='translate(268.38,163.79) scale(9.00)' color='black'/> + <use xlink:href='#gpPt0' transform='translate(319.75,202.70) scale(9.00)' color='black'/> + <use xlink:href='#gpPt0' transform='translate(371.11,208.05) scale(9.00)' color='black'/> + <use xlink:href='#gpPt0' transform='translate(422.48,168.36) scale(9.00)' color='black'/> + <use xlink:href='#gpPt0' transform='translate(473.85,89.51) scale(9.00)' color='black'/> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="2.00" stroke-linecap="butt" stroke-linejoin="miter"> @@ -286,10 +280,10 @@ <g fill="none" color="black" stroke="black" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <path stroke='black' d='M80.92,54.01 L80.92,422.40 L574.82,422.40 L574.82,54.01 L80.92,54.01 Z '/></g> + <path stroke='black' d='M62.92,54.01 L62.92,422.40 L574.82,422.40 L574.82,54.01 L62.92,54.01 Z '/></g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> - <g transform="translate(327.87,30.91)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> - <text><tspan font-family="Arial" >Time per document to build an index of various sizes</tspan></text> + <g transform="translate(318.87,30.91)" stroke="none" fill="black" font-family="Arial" font-size="12.00" text-anchor="middle"> + <text><tspan font-family="Arial" >Time (in ms) per document to build a Xapian index of various sizes</tspan></text> </g> </g> <g fill="none" color="black" stroke="currentColor" stroke-width="1.00" stroke-linecap="butt" stroke-linejoin="miter"> diff --git a/topics/xapian-scalability.gmi b/topics/xapian-scalability.gmi index 21eb1d4..cfc4e46 100644 --- a/topics/xapian-scalability.gmi +++ b/topics/xapian-scalability.gmi @@ -2,17 +2,16 @@ As the index grows larger, Xapian takes longer to insert new documents. Shown below is the time (in seconds) taken to build indices of various sizes (in number of documents). -* 10k: 5.0 -* 20k: 10.7 -* 40k: 21.1 -* 80k: 42.3 -* 160k: 87.2 -* 320k: 176.4 -* 640k: 353.9 -* 1280k: 727.5 -* 2560k: 1494.3 -* 5120k: 3037.9 +* 10k: 4.45 +* 20k: 9.48 +* 40k: 20.40 +* 80k: 41.70 +* 160k: 81.63 +* 320k: 159.88 +* 640k: 318.84 +* 1280k: 651.47 +* 2560k: 1357.73 -Notice that it takes 607x, not 512x, more time to build the 5120k index than it takes to build the 10k index. In terms of time, the 10k index takes on average 0.5 ms per document while the 5120k index takes on average 0.59 ms per document. We show this graphically below. +Notice that it takes 305x, not 256x, more time to build the 2560k index than it takes to build the 10k index. In terms of time, the 10k index takes on average 0.45 ms per document while the 2560k index takes on average 0.53 ms per document. We show this graphically below. => xapian-index-building-scalability.svg |