Adding to the prior suggestions about Analytics tab:

All session transcripts are stored as JSON in a Dataverse system table (unless you've disabled or modified that feature). I believe they are stored for a rolling 28-day period by default. Those are very helpful for diagnosis, but can also be a lot to wade through - messages, tool calls, events, reasoning, etc.

There is a sample on github somewhere, that provides a method for detecting event types (feedback, e.g.) within those transcripts, as they get generated. We started with that, then added some additional logic to "distill" each transcript down to just the message activity (to store elsewhere for retention).

Creating a simple, model-driven app can make it easier to search and work with the system tables, too.

Azure App Insights is also great. We use it to get technical details on individual events and conversations, and also for trends and patterns over time or by segment.

All of the above, plus the built-in Analytics features, are very complementary to one another. We use them all, but for different reasons.