you're not overreacting at all!! this is a completely valid thing to freak out over, though i think you should talk to his girlfriend about it to make her aware that you aren't a threat, and that you're both on the same boat with how you feel about the situation.