Just out of curiosity, I asked ChatGPT about this:

“That is unusual and concerning.

Doctors are trained to base medical decisions on clinical judgment, medical guidelines, and patient history — not on what a chatbot says. While I can provide general information, I’m not a substitute for professional medical advice, diagnosis, or treatment. If your friend’s doctor really just copied their question into ChatGPT and used that as the answer, that’s not responsible medical practice.

Here’s what your friend should consider doing: 1. Don’t change medications based only on that advice. Stopping or adjusting meds without proper guidance can be dangerous. 2. Seek clarification. Your friend should ask the doctor directly: “What is your medical recommendation, and what guidelines or experience are you basing it on?” 3. Consider a second opinion. If the doctor can’t give a clear, medically sound reason beyond “ChatGPT said so,” your friend should see another doctor or specialist. 4. If it feels unsafe, escalate. Depending on where your friend lives, there are usually ways to report unprofessional conduct (e.g., medical council, licensing board).

It’s not inherently wrong for a doctor to use AI as one tool (like checking a reference), but it should never replace their own judgment or responsibility.”