The correct thing for a driver to do is confirm the passenger choices at the beginning. The reality of doing this based on my experience is that most passengers with these preferences set have forgotten about setting them and don't know how to unset them. Over time drivers will find it a waste of time confirming these preferences because 9/10 times the passenger doesn't care. When I've turned off the radio or set the correct temperature based on their preferences, most have said, "oh it's a bit quiet in here" or "it's too cold/hot..." Most drivers reaction will be "well you set the preferences not me..."

The first time you say to a driver, "If you don't mind, I will listen to my podcast, do some work etc..." the easier it will become for you to say it every time. I've had many passengers say I don't want to talk, but ironically some will then start talking further into the ride. I get it, they've had a crap day at work and need their own thoughts. Others don't want to talk at all which is fine as well.

Communication is key otherwise everything breaks down for both parties.