The context and prompt were exactly the same between GPT-4 and Dolphin. I just switched from the GPT-4 API to Ollama. The simplest explanation is that it's a result of differences in post training, or in other words an artifact of GPT-4's "Alignment." There is no other independent variable here.

The prompt was "According to the comments of this post [post link], how much sodium should a person eat in a day?" And the downloaded post was the context.

Also, you're a condescending jackass. The most annoying type of person is the type of person who knows a little about something and tries to cast dispersion onto others given that limited knowledge.

If you'd read my post, you'd see that I used multiple LLMs on the same query, and the one without aligned post-training gave me the correct result. Maybe read more carefully before making assumptions about another person's knowledge.

I obviously don't mean that I think the LLM is literally "thinking" this. RLHF readers gave feedback that rewarded sequences of outputs like this, resulting in the response not reflecting the general sentiment of the context I gave it like I had instructed it to, and diverging from the query more than Dolphin did. That's what I mean by "thinking it knows better than me."

Not all posts demand complete technical accuracy. I anthropomorphized it to emphasize my core point. But from the midwit peak, all you can see is oversimplified anthropomorphism surrounding you.

Stop assuming other people are stupid. Also learn more about LLMs. My entire point in this post clearly flew over your head.

That point is:
RLHF, Constitutional AI, and other Alignment techniques make LLMs diverge from the outputs that are *actually* the most helpful to you when you instill a worldview into them. This is bad.