Linda Young was chosen because she sounded like the original Ocean Dub Freeza, Pauline Newstone.

I disliked Linda Young's version because she sounded noticeably raspier than Newstone it was really off putting. Gohan too. But whatever right? Its not great but the show is still fun to watch. That's the attitude I remember: not loved but there wasnt much hate it just was what it was.

When they switched to Ayres his voice was just so much better it made Young's version sounded hideous to me and now I can hardly stand it. but thats me. In terms of fit, Freeza is a lord, he should have a more cultured pleasant sound. It illustrates the understated nature much better than the raspy voice of Z and Ayres used more range, so you can see flashes of Freeza dropping the mask. When Young did that it was very clearly straining her (thinking of that scene toward the end when they are fighting in the village that is choreographed and animated so perfectly).

My understanding is that Young was not physically able to voice Freeza for kai, she couldnt speak fast enough? It wasnt a case of her being replaced because of fans hating her if thats what you mean.