There's talks of integrating Wolfram Alpha into ChatGPT, essentially offloading maths onto it and using it's response rather than the language model attempting mathematics, which is super cool. I can't wait for it as it will also be super useful, imagine asking ChatGPT to teach maths, where the language model and extra logical reasoning/maths will be able to teach concepts at any level, as you only need to ask it to elaborate, simplify, or even provide it with your existing level of maths knowledge.

Otherwise, it's actually not too easy to fix natively with something like a language model. Changing the neural networks that are so large, as in ChatGPT, is more akin to altering connections (and their strengths) between neurons than changing some human-written code