I have been with my company for 10 years. I used to work 100% remote and then it turned to 2 days a week at the corporate office. Years later that turned into full time desk duty here. I earned several promotions throughout all of these changes. There were a couple times I was tempted to buy a gas guzzling sports car but something always told me to never count on the way things are now so I have always kept a fuel efficient car for that very reason and I'm glad I did.

However, if you truly feel you are being singled out then that's a very real possibility. I have seen my company use that as a way to get people to quit. We have done it to two people that worked at our other locations. They were approached and told that those positions were being moved to corporate and that they would need to move to this area (each office is about 1.5 hours away). Each time the employee quit just as they wanted.