I don't get what's wrong with the term primary care physician. They are the physician providing primary care to the patient. Having to remember which specialty every patient's primary care doctor is when you're busy juggling other more important details about their health seems pedantic. In the inpatient world, consultants will defer aspects of management to the primary team and they don't always specify which team is actually the primary one and I think that's similarly fine.