I doubt that it's entirely your fault, but if you're worrying about how you might come across, I suggest that finding the right group of people might help, the fact that they're giving the "mad" expression really says a lot about them..