fleet-memory/hindsight-dev
Nicolò Boschi 61bf428ba9
perf: fetch all recall chunks in a single query instead of batched while-loop (#475)
Replace the multi-round-trip while-loop in step 5.5 of recall_async with a
single WHERE chunk_id = ANY($1) query covering all candidate chunk IDs.
Token-budget accounting happens in Python after the single fetch.

Measured on a 97K-unit / 98M-link bank (budget=HIGH, include_chunks,
include_entities):
  p50:  1.209s → 0.611s  (−49%)
  mean: 1.534s → 0.772s  (−50%)
  p95:  3.366s → 2.316s  (−31%)

Also update recall_perf.py benchmark to use Budget.HIGH, include_chunks,
include_entities, and a realistic mixed fact_type distribution.
2026-03-03 14:52:48 +01:00
..
benchmarks perf: fetch all recall chunks in a single query instead of batched while-loop (#475) 2026-03-03 14:52:48 +01:00
hindsight_dev doc: add go client examples (#380) 2026-02-16 14:43:03 +01:00
upgrade_tests misc: fix vertex/gemini errors and use it for ci tests (#414) 2026-02-20 22:35:38 +01:00
pyproject.toml Release v0.4.14 2026-02-26 18:03:14 +01:00
README.md rename to hindsight (#2) 2025-11-25 19:28:26 +01:00

Memory Dev/Utils scripts