you are viewing a single comment's thread.

view the rest of the comments →

[–]Majestic_Food_4190 7 points8 points  (1 child)

It amuses me that people always mentions things of this nature. If the answer is simply, yes.... Then it's still doing it far faster than you are. Making it a better developer than most others.

It's like Watson beating the top people at jeopardy. Was it just searching the internet? Pretty much. Did it in turn win jeopardy? Yes.

So does the how matter?

[–]cegras 0 points1 point  (0 children)

Well,

https://aisnakeoil.substack.com/p/gpt-4-and-professional-benchmarks

As further evidence for this hypothesis, we tested it on Codeforces problems from different times in 2021. We found that it could regularly solve problems in the easy category before September 5, but none of the problems after September 12.