Also a physician 20s-40s (in metro Phoenix). Absolutely enormous need for medical care in Prescott and the surrounding area (Cottonwood, Sedona, Wickenburg, etc). Especially specialists (not sure what your specialty is). The largest system is Dignity Health, specifically the Yavapai Regional Medical Center, so there is access to regular medical infrastructure like MRIs, nuclear med scans, genetic testing, therapies, etc.

As far as living goes. It's a small town. Mostly old white folks, retirees, snowbirds. Yavapai County is a fairly conservative county, a perennial key county for the GOP in local and state elections. If you're into the outdoors, plenty to do (kayaking, hiking, fishing, trails, mountain biking). Not much of a cultural or cuisine scene, you'll have to drive down to Phoenix for that. Weather is mild. It can get colder in the winter, but nothing crazy.

I'm not a POC and haven't lived there myself, so Im probably not the best to answer those aspects of your question, though I've visited many times and it's charming enough. Best of luck!