schema · evergreen

Four hard things about code RAG

Vector search is the easy part: exact symbols, Turkish over English code, staleness, and saying no.

Vector search is the easy part of a codebase RAG. The four things that are actually hard decided every part of this system.

what breaks first
exact symbolshandleAuthCallback
Turkish → Englishprose vs. code
stalenessrepo moved on
saying "no"kNN never says no
ProblemWhat we didMeasured
Symbolsroute symbol-shaped queries to BM251.0 / 1.0 recall@8 / MRR
Turkish questionsmultilingual embedder, optional LLM descriptions0.04 → 0.684 → 1.0 (subset)
Stalenesssha256 manifest diff on push38 changed files in 23 s
No answerthree score bands + negative golden casesabstain 0.846, false alarm 0.048

Every row is a decision with a number next to it. The rest of this garden is the story of those numbers — including the ones that changed our minds.

#rag #code-search

See this note on the whiteboard →