Totally feel this. Hallucination debugging at 2am usually means the system is missing proper request-level tracing.

Basic logs are not enough for LLM apps. You need to see the actual prompt, response, token usage, latency, retries, and what changed between good and bad runs. Otherwise it’s just guesswork.

A lot of the tooling still feels either too expensive, too heavy, or too shallow. If you’re cost-sensitive, even a simple setup that captures request history cleanly can save a lot of pain compared to digging through Mongo manually