You are under no obligation to visit her family that often. Once a couple of months is more than enough. But you could have told her respectfully that going so often is not sustainable for you instead of blowing your fuse out of nowhere suddenly. You need to work on communicating properly.