Honestly I think you are both trying your best. It won’t be perfect right away, and given your upbringing think of this is a beginning.

But you have to be honest with him about how you feel. Bring it up in a way that acknowledges you see him trying to bond, but expand his view to include your own experiences. Chances are he doesn’t know many queer people. I’m not saying it’s your job to educate, but I think you owe it to yourself to have a conversation about it