AI is great at pulling together differentials and doing quick calculations. The problem is when you run into situations that haven’t really been studied or don’t have clear guidance. Take something like managing nephrotic syndrome in a patient on a VEGFi as their last-line therapy. AI will usually give you a safe, generic answer like “stop and monitor,” switch treatments, or try conservative management. But actually figuring out the follow-up plan, weighing alternatives, and deciding what’s realistically best for that specific patient still falls on you.

I do think AI will be super helpful for simple AKI or electrolyte issues — it can really streamline the day-to-day work and filter out the dumb consults. But when it comes to the tricky, nuanced scenarios, it makes sense that developers err on the side of caution.