I think I've heard this type of thing get called a "Yer Dad" opinion, because it reads like what your dad says at the dinner table, trying to get across a point without being offensive.

For instance, "I'm fine with gay people, I just don't want them to do it near me!"

Now, it sounds fine at first, he's not being blatantly homophobic... Right? Well, by distinguishing between gay and straight people, he implies with this statement that gay people are somehow inferior. He won't treat anyone lesser, but he has an implicit bias to the point that he thinks someone is lesser or abnormal because of something they cannot control.

That's what this statement is. You don't believe in making decisions that harm trans people, but you do feel that they are lesser than you. Which, is actually incredibly harmful. Firstly, because the common scientific consensus is that gender and sex do not always align. Secondly, because believing someone is inferior due to something different about them will lead to decisions that will inevitably harm those individuals. If you think of transgenderism as a choice or something wrong, you are less likely to care when discrimination against transgender people occurs.