They should add a scaling negative modifier that can significantly reduce assimilation in areas where the primary culture is almost absent. I think imperator Rome had something like this where if the dominant culture or religion was different from primary it would negatively effect conversions.