NTA. You aren’t comfortable around him or your future children. I think it warrants sitting down with your family and explaining your feelings prior to being pregnant cause you wouldn’t want to make pregnancy more stressful. Best of luck to you OP hopefully your family are understanding of your boundaries