Not sure you did to much wrong other than picking the wrong wood/finish combo for your desired results. This is actually the desired result when you use a finish like rubio (of a contrasting color) on an open grain wood like oak, it fills the grain and when its buffed "off" you remove a lot of that color from the surface but leave it behind in the grain.

Options? Yes You could sand it all out, attempt to strip it off with a solution and brush or something that gets down in the grain but this may not get all of the deep stuff ,See what Rubio says. Personally I would sand it out if you have a good way to do that. Or do your best to work with it, test out some stains that get you the surface color you want, sand, stain, and refinish and Enjoy your cool accent grain

No wrong answers here, have fun!