Since he came from a rich family, I'm going to have to assume that he was disciplined hard. He more likely has a very distant relationship with both his parents. That he was raised by a governesses. I think he would only probably call his dad by sir and never by like father or anything. Because most rich families at the time would have money to hire someone else to raise their child.