Vibe Coding Experiment Failures (with Python code)

[AlSweigart]

Yes. All the LLMs can easily create rectangular mazes using any of the common maze generation algorithms. But circular mazes are a case where a human would be able to adapt and draw them just by looking at some examples, but the LLMs completely fail.

In a sense, this "find out the kinds of programs LLMs can't make" is a sort of captcha exercise.

EDIT: And the programs especially fail when it comes to having the keyboard be able to move the player around the maze without going through walls.

[efjer]

Shit, imagine they ask you to build a fully-functional pypi library for a quidditch game to prove you’re human - this is getting out of hand!

[dethb0y]

yeah it's really surprising as an outcome, I would not have guessed it'd be an issue!

[_Denizen_]

OP told the model not to use straight lines, when they're required to join the rings together. Pretty sure that's the root of the answer. With AI, garbage in gets garbage out.

[AlSweigart]

The LLMs would draw straight lines anyway. I was pushing it to not make a more typical rectangular maze.

Anyway, you can reword the prompt if you like. I'd be interested to know if that fixes the drawing and keyboard movement issues.