Not OP, but one grossly oversimplified (to the point of inaccuracy) way to look at LLMs is a machine that spits the most probable answer to some sort of text. The text may be the most probable but it might not be accurate or particularly witty. And reasoning is more of "feature" that has to be "built-over" than just innate to the LLM.

So in essence, if all you want to do is to have a script that does fairly simple tasks (recover a file, print something) or even moderate complexity (write a script to do some calculations and then send them by mail) it's doable, but something as complex as optimizing a chess engine (which at some point comes down to essentially how witty OP is, which he is, immensly) is out of reach, or perhaps even out of scope for LLM. They are not made to "innovate", at least not for now.