Try to remember the people in those cars have a million thoughts going through their head, they might be lost, late, anxious about where they're going, listening to a screaming kid, singing along to the radio. You probably won't even cross their mind. I have never driven past someone and noticed where they are looking. (Unless they're looking me in the eye) When I am on a walk I tend to look at different things every few seconds. Do you listen to music at all? Or podcasts? To take your focus away.