diff options
| author | Alexander_Kabui <alexanderkabui@proton.me> | 2026-10-13 15:11:33 +0300 |
|---|---|---|
| committer | Alexander_Kabui <alexanderkabui@proton.me> | 2026-10-14 07:27:02 +0300 |
| commit | a6003ffbfe40aadaa1d9548bdc3294987b97d304 (patch) | |
| tree | c1bf7ef12eba17ac178090ae48fddb807e23acd7 /src/bin | |
| parent | a188b75157516c5e00dd130d9ca8dfbd6cf36679 (diff) | |
| download | genenetwork4-a6003ffbfe40aadaa1d9548bdc3294987b97d304.tar.gz | |
* src/indexer/run.rs (write path): stream documents, not buffer all.
Building and writing each document as the crawl yields it is leaner than collecting the whole set in a Vec, so live documents stay O(1) and peak memory stops scaling with the corpus. * src/indexer/livemem.rs: the live-document counter that proves it. * src/indexer/build.rs, src/indexer/mod.rs, src/bin/gn-indexer.rs: adapt to the streamed build and write signatures. * Cargo.lock: repin xapian-rs 97fd343 -> 70c5eac (the write-API set).
Diffstat (limited to 'src/bin')
| -rw-r--r-- | src/bin/gn-indexer.rs | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/src/bin/gn-indexer.rs b/src/bin/gn-indexer.rs index 3b70945..d81990e 100644 --- a/src/bin/gn-indexer.rs +++ b/src/bin/gn-indexer.rs @@ -81,6 +81,7 @@ fn main() -> ExitCode { println!("deleted={}", stats.deleted); println!("unchanged={}", stats.unchanged); println!("index_doc_count={}", stats.index_doc_count); + println!("max_live_documents={}", stats.max_live_documents); ExitCode::SUCCESS } Err(error) => { |
