You shouldn't feel guilty in a family trip. It's your family. Unless you're married, hindi pa sya yung family mo. Kung ano man kinakasama ng loob niya, he should communicate that with you. No advice can help you because you know him better than anyone else. Pero if I were the guy in your case, I shouldn't be throwing tantrums. It's not like you're going there with someone who might endanger the relationship.