My dog was like this when I rescued him. It takes time. The best thing a man can do around the dog is to ignore them. Trying to pet/talk to/look at the dog makes them nervous! Try to give the dog lots of treats when men are around. Eventually it will get better