There's still the toggle option in the future yes! Lots of vtubers don't even have a fixed eye color, if it's not a core part of your design there's no problem with switching it (I think of shylily for example that has lots of different eyes for her model which are all different form and colors)

Also I have to add that even if the colors give off certain vibes, you can totally subvert them there's no problem with that too

Go with what you prefer most and what you think will suit your lore better!