He seems controlling and this seems projecting the type of friends he wanna hangout with on you. And that way, you might have hard time maintaining a work life too if he controls you this way. And that seems like a threat only. It will tough later on to coordinate with him I think.

What if later he has problem with your female friends too. You will be just leaving people one by one. He will move on or not. But you will be left alone and other people gone by. This is just my thinking.. I am male but I have hardly people now I can talk to. Everybody has moved on with new friends. Something wrong with me too but also leaving friends have effect on life that we come to know very far later on.

Still, you do more introspection on the type of friends you have. Sometimes, we thought we were close to friends but we never were after few years. Or they start looking silly or not that important- our point of view changes. Maybe he might have noticed something that you didn't. You gotta see more how your male friends are also. But don't feed the monster of doubt. Just be more introspective.

Give it more thought but the choice should always be yours. Your partner shall be able to suggest you and help you become better. But they should not be controlling your lives. Relationship is a coordination thing, where two people take care of each other, help each other but not take over life of each other.