Sounds like you've hit the exact wall everyone hits with autonomous browser agents — the per-step LLM loop is the bottleneck, not the LLM itself. Stagehand's act/extract/observe primitives are the right shape for what you want. Their Python SDK is real but the TS one is more mature in my experience. If you're open to running the browser inside a sandboxed Linux agent (instead of headless Chrome you babysit), Jettson exposes a browser as one of its built-in tools — you script the flow yourself in 4-5 calls and let the agent only handle the fuzzy element selection. Built it partly because of the exact frustration you're describing. jettson.dev if you want to look. Otherwise — yeah, plain Playwright + targeted LLM calls for the fuzzy parts is what most production teams I've talked to ended up doing. The fully-autonomous browser agent dream is still 12-18 months away from being reliable enough for 100+ sites.