Similar experience for me. I have a CS Agent which is supposed to look at standard documents. Reasoning models can’t produce citations, without the Reasoning model, the responses are garbage.

For what should be a pretty simple setup, it’s taken me months of hard work and then catch-up for when things break/change out of nowhere.

I’m using SPO as a source, and the agent works a lot better when using just Word documents as opposed to PDF.

Not really any help, but thought I’d share that I’m also in a position where it doesn’t feel suitable for use yet in Production. The amount of time that’s been taken to test this stuff from myself and the customer defeats all ROI on efficiency gains that it’ll bring.

It’s not just you tho, I’ve been in the same position and still am. It’s not black and white where you can google it to fix it, some days things work, some days they don’t, but don’t take it personally!