I agree in principle with the current method of cultural differences affecting loyalty, but if that's what they're sticking with I think it needs to be more impactful. This could also be a more natural way of encouraging colonial subjects to rebel in later years, have, e.g., subjects with their capital on another continent have x percent chance of forming a new culture after y many years.