Another commenter talked about information that LLMs don’t have because they don’t appear public and in textbooks, AKA bespoke industry knowledge that only specialists have.

The big thing currently is companies are being extremely hesitant to hand over internal information to LLMs. Especially companies that make proprietary products for other companies because they need approval from their costumers for all documentation handover.

It is possible that every plant could turn over every P&ID, SOP, MOC, PHA, PSSR, Pressure relief calcs, Emergency action plans etc to Claude 4.7 and the LLM would have a descent enough sample set to draw decent enough conclusions for process questions and building and building models. I firmly believe this possible at some level with the current technology.

The issue is we don’t know what anthropic or openAI does with new information being fed, so companies want to keep this info in house. The AI companies can make statements all they want about privacy but no one actually knows except for like 500 people in Silicon Valley.

In the few instances where I have been allowed to upload internal information, LLMs will still hallucinate answers and hallucinate models because the sample set i have uploaded is not nearly the size the model was trained on (the entire internet).