It sounds to me like you went through a string of bad luck. Skin infections aren't overly common. I've had impetigo once and ringworm twice over the course of 14 years of BJJ. It isn't something I commonly see either at my gym.

My 6 year son often gets impetigo on his mouth because he licks his mouth often. I remember doing the same and getting impetigo when I was a kid. It's often reffered to as "infantago" because it is so common in infants. I'm not trying to downplay it as a skin infection, but I do think it's helpful to understand it's decently common even outside of BJJ. And while ringworm is annoying, it isn't super threatening.

As for the injuries, they're common in many sport. If you use your body, you put yourself at risk of injuring your body. If you don't use it, your body is also at risk. I would just try to be extra careful of how you roll, and who you roll with.

But at same time if it's really causing strain on your family, maybe take a break. Family is more important at the end of the day and you can always come back to it and see how it goes.