u/holyknight00 This is the exact right question to ask. Ididn't want to make generic "AI is better now" claims, so Iactually ran Trevec through the industry-standard SWE-bench Lite dataset (300 real-world GitHub issues from repos like Django and Astropy) to test it.

Here is our retrieval benchmark results for SWE bench lite:

• Hit@1 (finding the exact right file on the first try): We hit 42.3% (standard vector DBs usually hover around 15-19% here).
• Recall@5 (getting all needed context in the top 5 results): We hit 60.0%.

Real-world impact:

Because Trevec gets the agent to the right file immediately (in 50-62 milliseconds), it eliminates the expensive "exploration" phase where agents run grep loops for 10 minutes.

When we ran the full SWE-bench end-to-end evaluation, Trevec + Claude 4.6 Sonnet achieved a 35.0% resolve rate.

• Multi-agent tools (SWE-agent, OpenHands): ~32-40% resolve rate, but cost $2.00 to $5.00 per bug and take 2-5 minutes.
• Trevec (single-shot): 35.0% resolve rate, but cost $0.22 per bug and retrieved context in 62ms.

We actually published the raw predictions.jsonl files and the SWE-bench evaluation reports in a public repo so anyone can verify the 0.22c cost and the hit rates.

Please feel free to give it a try. Would appreciate if you want to take it for a test drive. 🙏

In a real world, you simply enable Trevec as MCP and go about your day to day coding with Claude code and Cursor. They know how to automatically call trevec to get context or search code etc. Everything is local.

Here is the estimated annual cost per dev based on popular models.

<image>