perf: collect prune used blob ids in rustc-hash FxHashMap - #568

Open

BradKollmyer wants to merge 27 commits into

rustic-rs:mainfrom

BradKollmyer:perf/prune-used-ids

Commits on Sep 6, 2026

fix: request B2's maximum list page size
BradKollmyer
committed
9210d41
fix: fetch 4 MiB unused pack gaps in one read
BradKollmyer
committed
d468d44
fix: range-GET prune repack chunks in parallel
BradKollmyer
committed
a75f3c8
fix: prefetch index files with extra IO workers
BradKollmyer
committed
b99e719
fix: scale tree loaders during prune used-blob walk
BradKollmyer
committed
ec07d6a
fix: store prune used blob ids in a HashMap
BradKollmyer
committed
43365be

Commits on Sep 7, 2026

fix: collect index entries in bounded chunks
BradKollmyer
committed
edb089d
fix: keep cached pack files open for tree blob reads
BradKollmyer
committed
0464477
fix: stream-decode trees during prune used-blob walk
BradKollmyer
committed
4674695
fix: walk unique trees depth-first
BradKollmyer
committed
721dc03
fix: list pack files during prune index and tree walk
BradKollmyer
committed
c65570c
fix: start prune pack listing after the index is loaded
BradKollmyer
committed
5e7996f
fix: use fewer stream_list workers on a warm cache
BradKollmyer
committed
b664070
fix: use fewer tree loaders when pack files are cached
BradKollmyer
committed
188e5bc
fix: build cache test payloads without lossy int casts

BradKollmyer
and
claude
committed
4ef023f
fix: bound cached handles and synchronize portable range reads
BradKollmyer
committed
34d586c
fix: size cached pack handles from rlimit minus a reserve
BradKollmyer
committed
3631eab
fix: convert rlimit to u64 for 32-bit prune cache cap
BradKollmyer
committed
a9716cd
fix: reuse a zstd decompressor per thread for blob reads
BradKollmyer
committed
be68643
fix: decode prune tree blob ids with a hex nibble table
BradKollmyer
committed
7961821
fix: record prune used blob ids from loader threads
BradKollmyer
committed
186a925
fix: stream-decode prune tree nodes without full node structs
BradKollmyer
committed
19c41bd
fix: fill prune used blob ids in per-loader maps
BradKollmyer
committed
9aa8740
fix: use FxHash for prune used-blob maps and tree visited set
BradKollmyer
committed
461977d
fix: scan prune tree JSON without serde node field parse
BradKollmyer
committed
8d37cf5
fix: preserve escaped JSON references during prune
BradKollmyer
committed
b29a5cd

Commits on Sep 19, 2026

fix: parse prune trees with a serde struct of type/content/subtree
BradKollmyer
committed
0d55a57