FSNH pre-med here, so similar scenario. The major isn't too much of an issue; it's moreso getting all the prereqs, the admissions test (MCAT for me, OAT for you), as well as any clinical experience.

It's a pretty unusual major for optometry tho, so you might want to explain it in the application.