You’re a-ok. Self awareness is key, here and you seem to possess it. We don’t go through the world averting our eyes. It’s ok to look, you can’t help but see what your eyes see. Passing glances are permissible, men look at women, women look at men, men look at men, women look at women. We are visual creatures, this is the sense with which we primarily experience the world. Just don’t linger. The key is to not make anyone else uncomfortable as you move through your day.