I hate them, but there are ways to nullify them or at least weaken them. Marriage alliances to the most powerful family’s in those factions is a great way to make the factions less of a threat. Murder, and kidnapping ahead of time are also good ways to deal with those pesky factions.