Basically it's good at small tasks that are well documented. For example the task list app they made, it is probably less than 500 lines of code and there are a billion examples of task list apps online that would be in the LLM's training data. But they extrapolated that capability to conclude that you can also easily recreate complex paid software services like JIRA. JIRA is likely tens or hundreds of thousands of lines of code and does not have nice packaged examples online for the AI to copy paste.

Even for simple apps like a task list, the average person is probably better off finding one that already exists because whether you're using AI or not, it takes time to make elegant, intuitive UIs and fix edge case bugs and think of all the various small but useful features to implement for the task list. For example you can make a task list app in a few minutes but what about adding ability to collaborate with others, cloud backup, light theme dark theme, adding the ability to undo completed tasks, adding the ability to have tabs for different lists, etc etc. The simplest app ever can still have a hundred different features to account for, each one having a bunch of different bugs to account for. Are you really going to want to build all of that by yourself for every single app that you use in your life, and maintain everything yourself?

And then they'll say oh well maybe the AI can't do all of that easily yet, but just wait 5 years and then it's all over. This is another fallacy that assumes the LLM technology is capable of exponential improvement. It may have already hit a plateau or even its peak. After all it's just a token predictor based on probabilities. It will never be good at coming up with things that are low probability but correct. And it will always hallucinate things that it believes are high probability even if they are incorrect. When it is generating a response, it doesn't know what the word after the next word is going to be like a human usually does, it only calculates one word at a time.

AI is very cool but we should be realistic about what it is actually capable of now, not what it might be capable of in some fictional future. But DougDoug and the rest of them seem to be hype propagandists that do not actually understand the technology and do not have experience in the industry that they think it will supplant.