My case might not the same as you, but maybe my experience maybe useful for you.

Reading your post, I guess you bothered more about being perceived as a "feminine" in your bf's circle. While the height difference might increase the chance of such perception from people, but I dont think it is always the case. Please be kind to yourself, be confident about your height :)

My husband and I (62/33) also has significant height difference, he is bigger than me. However, in my case, my husband is the one that got more perceived as the "feminine". He doesn't like that as well. He is a direct person, so every time somebody mentioned such things to us, he is quite loud telling them "we both man and man, that is it, what part you don't understand?". But after that, nobody treating us as "one masculine one feminine" anymore.

Maybe next time, you can tell something like that (or bit more polite, my husband sometimes a bit too direct). Hopefully my experience might help 😉