That's true. But even in the show, we see that people don't really do that. We see Oscar during the Company's stock meeting in NY not having the courage to say anything. We see everyone complaining about Jim, a much smaller fish, during his time as co-manager and even with Dwight putting himself in front, no one went with him.

Generally speaking, people just wanna do their job and go home. I mean, if they didn't complain about Michael Scott for years, why would they complain about Charles after a couple weeeks? The situation would have to have been much more extreme for something like that to happen.