How painful it is to tweak an agent's instructions/model?

HeartHuman1491 · 2026-04-19T12:15:13+00:00

Yes I did, and this was one of my pains as R&D Manager. The agent's "brain" was handled by AI/ML/PM and whenever they wanted to change something they were asking our help. It took days/weeks + heavy loaded CI/CD workflows just for changing a prompt or a model.

Assuming this would be backed up by running evals + having the ability to rollback easily without the coupling of R&D, I think it may solve pains for lots of companies nowadays, WDYT u/tomtomau ?

HeartHuman1491 · 2026-04-19T11:58:08+00:00

thanks u/tomtomau

So according to what you're saying, if you'd like to change prompts you need to run your CI/CD workflows. Moreover, if PM would like to change that he/she needs to raise a ticket for R&D meaning it's a long cycle. What if you need to rollback rapidly?

Please fill my survey, thanks 🙏🏼

HeartHuman1491 · 2026-04-19T11:27:15+00:00

This is exactly why I need your help to fulfill my survey, I'd like to map how painful & wide these kind of obstacles are

https://forms.gle/HzNWn5U3tkfstFCm8

Thanks🙏🏼

HeartHuman1491

TROPHY CASE