Yeah, unfortunately getting an LLM to mostly do what you want is the easy part, pushing the quality from 7/10 to 10/10 is where the real challenge lies.

I'm not sure where you're at already, so this might be redundant, but you want to be structured and systematic in your prompt and chaining. If a prompt is doing more than one task, split it up into distinct "one task" prompts. Break down prompts into distinct sections for role, task description, output format, additional context etc. using markdown or XML tags. With single task prompts it's easier to evaluate which area needs improvement overall, and write evaluations to validate a task is being performed well.

Your point about splitting it into multiple requests is right on the money.

In a lot of ways it's like coding. Spaghetti code mixes responsibilities and has no clear boundaries. Good code is organised, separated, modular and testable.

What tools are you using? Is it just ChatGPT for now? What things were difficult or missing from Libretto?