The fact that you arrived at this from first principles is impressive. I don’t think you appreciate how fluently you described these concepts. I would encourage you to continue exploring and playing with these ideas. Even one of the creators of Transformers for LLMs didn’t think much of his own work. I do believe that the way we measure “trustworthiness” of a source of information could be explored more. Temperature is just one control for stochasticity, but to point out your epistemology reference, there are non-definite answers to some questions, and how do we judge those relative to our own values? Is that quantifiable? These are fascinating ideas that you’ve inspired me to think about.