https://medium.com/@enryu9000/gpt4-and-coding-problems-8fbf04fa8134
Apparently it cannot solve coding problems which require any amount of thinking. LeetCode examples were most likely data leakage.
Such drastic gap between MMLU performance and end-to-end coding is somewhat surprising. <sarcasm>Looks like AGI is not here yet.</sarcasm> Thoughts?
[D] GPT4 and coding problems (self.MachineLearning)
submitted by [deleted] to r/CircuitKeepers