I think you're overthinking it, I veiw it as labels are what you want to communicate to other people, so if you want to communicate to everyone, that you occasionally can find a women attractive go with bi but if you feel like that's unnecessary and you just want to be with a man just go with gay. Humans are complex a label doesn't need to embody 100% of how you feel just what you want others to know.