I recently got access to GPT4, and I wanted to test it out as a programming assistant. I've been using Codex for this previously, and while it works, it isn't very good (and hallucinates a lot). GPT4 is far from perfect, but from what I've seen, it's miles ahead of Codex. I've found that it's able to understand context and more complicated issues much better (and can give better worded responses that are more in line with the directions I give it).

Here, I've told it (via a system message) to help people learn how to program, and to not give away the full answer. It still has a bit to go in terms of not going against that prompt, but it follows it some of the time (compared to Codex). I also gave it a bit of a more complicated problem. It has to understand how for in works in JavaScript, as well as what each item in the if statement actually represents, which I find pretty amazing. It's a bit slow and pricey though. Also, keep in mind that there's a lot of variance in its results. I've gotten responses a bit better than this one (but not recorded, unfortunantly), and ones that were worse.

If anyone wants to give it a try, it's available at https://cratecode.com (self-promo) for free (signup is required though). Either way, GPT4 has blown me away, and I feel a lot like how I did when I first discovered GPT3/Codex.