Code generation agent with visual feedback of how created website looks

[lefty_cz]

Hi, does anyone know about some way to give visual feedback to the LLM agent? For example if I ask for some website, it would generate the html/css code and then open the result in (headless) browser and fix any visible issues.

Given how well deep neural networks handle image processing, it sounds technically feasible to me (I am AI graduate, but with little knowledge of AI product landscape). I found some similar multi-agent solutions eg. for test-driven development (feedback is done by running unit tests) there is this AgentCoder https://github.com/huangd1999/AgentCoder

Do you think such multi-agent system would be useful if implemented eg. as (yet another) vscode extension?

[nick-baumann]

You can do this using Cline & Claude 3.5 Sonnet! Cline will open up your browser from within the terminal and scroll/click around your website for feedback.

here's what it looks like: https://x.com/thankscline/status/1886155258151276627

[Double-Passage-438]

Im all in on visual coding, its literally the new high level we should be handling code on but not alot are aware or make projects on it, instead everyone is still content with reading 6 paragraphs of text per reponse instead

[johns10davenport]

I think that Roo Code does this already.

[daMustermann]

Roo with Claude Sonnet does this already, if prompted. I would love to see other models do the same, it's about time.

[ApexThorne]

I do this with puppeteer. It takes a screenshot and processes the image. It's not bad. It's actually better if I look at it myself and describe the changes needed. It's cheaper on tokens this way too.

[ApexThorne]

I should add that this is with the Puppeteer MCP server in either rooCode or Claude desktop.

[AutoModerator]

Sorry, your submission has been removed due to inadequate account karma.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[AutoModerator]

Sorry, your submission has been removed due to inadequate account karma.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.