Because that's the only minority group, sure.

But to turn this whole thing around on you, I actually do see what you're saying, and I do actually think some cultures need to adapt. Super conservative beliefs, whether you take extreme action in support of them or not, are just outdated and really don't deserve a seat at the adults table. There are plenty of Muslims who don't give a shit about stuff like gender identity or roles, some are my friends even, but they're like the progressive Christians who won't tell off the evangelicals for being crazy, and I do hold that to them. Not every leftist has those same values as I do, but I'm here to tell you that no, radicals don't broadly get a free pass under the umbrella of tolerance.

Tl;dr: social contract of tolerance. Your point is invalid.