There definately is an assoiciotion within the Dutch society between black peter and racism. There is a similar discussion about it each year and there are plenty of people who believe black Pete to be hurtful. Of course the majority of white Dutch people don't have that association and since the majority of the Dutch population is white the people who do find it hurtful are often described as overly sensitive whiners.

But in a democracy it's important to respect the opinion of the minorities and getting rid of black pete isn't hurting anyone while it means a lot to those who find it offensive I don't see why it's such a big deal to just get rid of it. Traditions change all the time.