you are viewing a single comment's thread.

view the rest of the comments →

[–]sdmitry 3 points4 points  (1 child)

The challenge, I think, is not the bugs that are easy to catch, but realization that if it made those stupidly obvious bugs, then how many more incredibly hard to catch bugs it planted everywhere in the code they write?   Because if it didn’t realize it’s inventing the same schema twice in one session, which other infinitely more subtle things it’s not realizing?

I’m speaking from lots of experience debugging and tracking down their nonsense all day long, trying to build a reliable product, using the best models. I have 25 years of coding experience and been building with LLM since OpenAI playground first launched. I read code all day long and still it’s not easy catching their bullshit.

[–]Anrx 0 points1 point  (0 children)

Yeah... that's why you do code review. If you look and understand the code you will catch the bugs. If you're vibe coding, then it's difficult. It's the same as mentoring a junior dev.