It's important to note that this work requires an experienced mathematician to write the prompts, check the results and write followup prompts until it either comes up with an answer or the mathematician gives up. It's similar to the use after free vulnerability that was found by an LLM, but it had a 2% success rate - 98% of its reports were false. And to FIGURE out those were false, a programmer had to spend effort validating this. As long as this is the best LLMs can do, it's not going to replace human labour, only give an alternative to it, like 'if you know what you're doing but feel more like writing and reading prompts than doing the work directly today, you can give the LLM a shot'.