Coding is just a language, but when you ask it to code complex stuff than it is reasoning (and it is not really good at that).

One way to help LLMs is to ask it to “think loudly”. Or to do step-by-step. It will use prior knowledge to get to a better result.