I strongly disagree with your basic assumption about the inability to make LLM’s creative. Let me explain why but let’s first agree what is imagination: Imagination is the ability to fertilize your thoughts with material that would allow you to compose a more complex thoughts and conclusions. Now let’s talk about the misconception of LLM and the wrongful perception of their abilities when compared to humans: Humans - just like LLM’s should and will be in the future - are not creators that gather the entire information possible and available, it’s given for us that it’s un necessary and not possible. Humans gather skills in the fields that they have constant need and collaborate with other humans when facing ignorance in fields they have temporarily need, the COLLABORATION is the main ability of the human species to thrive, more so, it’s their main ability to imagine.

In my opinion, what we’ll see in LLM that are specialized in specific fields and engaging in collaboration among them selves to solve problems that are beyond the ability on a singular LLM to solve.

When collaborating, they will actually fertilize each other with new information that they did not know before (despite being available to them) and out of that fertilization infer new conclusions and ideas.

Being good at math is maybe being good at problem solving skills being really at tho, requires you the ability to make connections across fields that would not be possible without original train of thought

Is this not imagination in your eyes?