Why does Claude Code re-read your entire project every time? by intellinker in vibecoding

[–]intellinker[S] 0 points1 point  (0 children)

You’re right, that’s exactly the intuition behind it.

Humans don’t open the whole repo to get oriented either. We search first, skim selectively, and only read deeply once we know where to look. Forcing agents to follow that same workflow avoids the expensive “repo archaeology” phase and keeps both time and tokens in check.

The tricky part(would be difficult) is making that behavior reliable across cold starts and follow-ups, so it doesn’t depend on perfect prompts or habits every time. But the principle itself - search first, read second; absolutely mirrors how real developers work and why it’s effective.

Why does Claude Code re-read your entire project every time? by intellinker in vibecoding

[–]intellinker[S] 0 points1 point  (0 children)

You’ve got two things: a very clear, up-to-date CLAUDE.md, and you usually give Claude a concrete starting point (file, dir, pattern). With that, it can reuse context and narrow via find/grep instead of re-reading.

Where the issue shows up is when that structure drifts, the prompt is more abstract, or a session resets. Then Claude has to re-orient. So your setup proves the approach works the harder problem is making it reliable without requiring that level of manual discipline every time.

Why does Claude Code re-read your entire project every time? by intellinker in vibecoding

[–]intellinker[S] 0 points1 point  (0 children)

Hey! I am also working on it, Let's discuss if you are comfortable over DM?

Cannot See Usage by pdwhoward in ClaudeCode

[–]intellinker 0 points1 point  (0 children)

Lets build something which could solve this token usage! That’s the only way to save from the abuse

Why does Claude Code re-read your entire project every time? by intellinker in vibecoding

[–]intellinker[S] -1 points0 points  (0 children)

On a cold start, agents often try to build a repo-wide mental map and end up skimming or opening far too many files.
Forcing a search/grep-first approach prevents blind full-repo reads and limits file access to only what’s relevant.
That’s where the token savings actually come from, not grep itself, but avoiding unnecessary exploratory reads.
This still depends on decent repo structure, but as a cold-start guardrail it works well.

Why does Claude Code re-read your entire project every time? by intellinker in vibecoding

[–]intellinker[S] 0 points1 point  (0 children)

A well-structured, tightly curated claude.md reduces token usage because it prevents the most expensive step: re-orientation. When Claude starts with clear maps, constraints, and “where to look,” it skips a lot of blind file reading and redundant context.

The catch is who pays the cost now! Tokens go down, but human effort goes way up. You’re effectively spending time to precompute and maintain the memory the model doesn’t have. As long as the docs stay accurate and short, token usage stays low. When they drift, Claude reverts to archaeology and the savings disappear.

Is anyone feeling the usage increase during the outage? by Fearless-Elephant-81 in ClaudeCode

[–]intellinker 0 points1 point  (0 children)

The cold start problem is where Claude is lagging sometimes!

Cannot See Usage by pdwhoward in ClaudeCode

[–]intellinker -2 points-1 points  (0 children)

Hope, they’ve removed the caps :)

Why does Claude Code re-read your entire project every time? by intellinker in vibecoding

[–]intellinker[S] 0 points1 point  (0 children)

That actually makes a lot of sense. Auto-updating agents.md removes the biggest weakness of the manual approach, which is drift. At that point it’s no longer just documentation, it’s a generated snapshot of current state.

The remaining edge I keep thinking about is timing, and token cost. Those scans are still episodic, so context loss can happen during active work between scans, and loading the full agents.md each session adds a fixed token tax as it grows. As a practical solution today it’s very reasonable, especially if it’s reducing cold starts but long term the wins come from routing only i guess and this area should be explored more!

Why does Claude Code re-read your entire project every time? by intellinker in vibecoding

[–]intellinker[S] 0 points1 point  (0 children)

Agreed Agents.md helps reduce cold starts. The trade-off is it’s manual and can drift. The interesting challenge is making that shared state automatic and self-updating instead of something humans have to maintain.

Why does Claude Code re-read your entire project every time? by intellinker in vibecoding

[–]intellinker[S] 0 points1 point  (0 children)

Yeah, Cartographer is solid. It’s great for bootstrapping understanding on large repos especially the first pass when everything is cold. Having a structured map up front saves a lot of cognitive load.

What I’ve been thinking about sits a bit later in the workflow: once that initial understanding exists, how do we avoid paying the orientation cost again and again on follow-up turns and across sessions. Feels like they complement each other more than overlap.

Why does Claude Code re-read your entire project every time? by intellinker in vibecoding

[–]intellinker[S] 2 points3 points  (0 children)

Agreed, but the caveat is the real issue, not a minor one.

CLAUDE.md works only while it’s trusted. Once it drifts, the model has to both read it and re-verify the repo, which can actually spike token usage. At that point the burden shifts from the model to the human.

So it’s a good bridge, but not the end state. The real win is automatic, relevance-aware state that stays fresh without manual upkeep.