> TL;DR: a benchmark that finishes in 0.2 minutes did not run. Mine reprinted four-day-old numbers from a capture file committed to git, and I published them three times as a design trade-off. With the cache cleared, the same panel reads 19 → 32 → 3...
Every SHA, every raw number and every recovered file below is traceable to the repo. Where something broke, the commit that fixed it is named. Where something is still open, it says so.
Prologue: a Table in the Comments
On September 24, a comment...
Where It Started
The problem to which everything traces back: RAG search across an unfamiliar codebase sees the code, but misses the intent. Embeddings find a chunk by keywords, PropertyGraph finds a symbol by name, but to the question "where is t...
Civil engineering background. I am not an AI researcher, and I don't write synthetic benchmarks for a living.
I build an open-source Model Context Protocol MCP server called MSCodeBase. Its primary job is to give coding agents structured context a...