about summary refs log tree commit diff
path: root/src/bin
diff options
context:
space:
mode:
authorAlexander_Kabui <alexanderkabui@proton.me>2026-10-13 15:11:33 +0300
committerAlexander_Kabui <alexanderkabui@proton.me>2026-10-14 07:27:02 +0300
commita6003ffbfe40aadaa1d9548bdc3294987b97d304 (patch)
treec1bf7ef12eba17ac178090ae48fddb807e23acd7 /src/bin
parenta188b75157516c5e00dd130d9ca8dfbd6cf36679 (diff)
downloadgenenetwork4-a6003ffbfe40aadaa1d9548bdc3294987b97d304.tar.gz
* src/indexer/run.rs (write path): stream documents, not buffer all.
Building and writing each document as the crawl yields it is leaner than
collecting the whole set in a Vec, so live documents stay O(1) and peak
memory stops scaling with the corpus.
* src/indexer/livemem.rs: the live-document counter that proves it.
* src/indexer/build.rs, src/indexer/mod.rs, src/bin/gn-indexer.rs: adapt
to the streamed build and write signatures.
* Cargo.lock: repin xapian-rs 97fd343 -> 70c5eac (the write-API set).
Diffstat (limited to 'src/bin')
-rw-r--r--src/bin/gn-indexer.rs1
1 files changed, 1 insertions, 0 deletions
diff --git a/src/bin/gn-indexer.rs b/src/bin/gn-indexer.rs
index 3b70945..d81990e 100644
--- a/src/bin/gn-indexer.rs
+++ b/src/bin/gn-indexer.rs
@@ -81,6 +81,7 @@ fn main() -> ExitCode {
             println!("deleted={}", stats.deleted);
             println!("unchanged={}", stats.unchanged);
             println!("index_doc_count={}", stats.index_doc_count);
+            println!("max_live_documents={}", stats.max_live_documents);
             ExitCode::SUCCESS
         }
         Err(error) => {