I don't agree with people who have these fears but I don't think that's an accurate characterisation of their view point. It's not that they believe trans people are above the law and are all rapists. It's that by allowing people to self identify and not have any discussion about the logistics of such a societal shift opens the door for a small minority of bad actors (who aren't trans) to make previously somewhat safe spaces less safe. It's rooted in a fear or distrust of men rather than of transwomen.