about summary refs log tree commit diff
path: root/src/indexer/livemem.rs
AgeCommit message (Collapse)Author
2026-10-14* src/indexer/run.rs (write path): stream documents, not buffer all.Alexander_Kabui
Building and writing each document as the crawl yields it is leaner than collecting the whole set in a Vec, so live documents stay O(1) and peak memory stops scaling with the corpus. * src/indexer/livemem.rs: the live-document counter that proves it. * src/indexer/build.rs, src/indexer/mod.rs, src/bin/gn-indexer.rs: adapt to the streamed build and write signatures. * Cargo.lock: repin xapian-rs 97fd343 -> 70c5eac (the write-API set).