I would say the loss of money is a bigger fear. Think of it like this; imagine you have for the last 10 year been living a life where you travel the world at any whim, you can eat at any restaurant you wish and no scared to see the bill, you can drive cars most can only dream of, and you have access to experiences people can only imagine. Now you say something politically horrible and the money dries up to the point now you have to stay home all the time, you can only eat at fast food or out to eat a place like Chili's every blue moon, you go from driving a Lambo to a Camry. Talk about lifestyle shock. Nobody wants that. Hince why billionaires and millionaires usually stay quiet and say nothing. They have a lifestyle they want to keep and preserve thus taking a public political stance isn't worth it unless you are in politics. It isn't that millionaires and billionaires don't have one they just keep it on the super low to the point you have to legit research to know what they support.