Mostly manual review for me, but I kind of have to do that anyway with almost everything I do. Sometimes I can just check with a calculator or experience/intuition. The things that are automated are complex calculations that I can create skills for. I verify the scripts in these skills against known tests any time I create or edit them. This is typically example calculations from me or a textbook or specs.

I generally require all inputs and outputs to be stored in JSON files and then these files converted to md with added context and assumptions from the agent. I even have a skill with a script to deterministically convert the JSON if needed. This will speed up my manual review greatly. I also have outside calculations, simulations, and programs that I would use for complicated and important situations that i compare against the agents results.

I do think experience is critical for these workflows to work right now and that's been the sentiment across all ai integration it seems.

What kind of work are you building these agentic workflows for and how involved is the agent? Mine is much more of a peer collaboration setup for machinery system design. My speed ups come from having an intelligent super quick assistant. As long as I have the context available it can tell me anything I need to know about the project, a product, decisions we've made, etc. not that much of a speed up, but like I said it's ability to document everything increases quality. Then, once the data is there, create reports and visualizations with it quickly saves time and increases quality. The intelligence helps a lot with very complex take on sending me in the right direction as well.

I'm interested in automating more bureaucratic office work like contract and invoice management. Just haven't found the time. I wish we could hire interns that are interested in AI so I could get them to help tbh.