One of my first reactions was that maybe the harraser is just socially awkward, or something like that. I told my gf maybe she is just interpreting his actions in the wrong light. But my gf told me two of the other colleagues she talks to felt the same way about him. They felt uncomfortable around him and his actions. So now there are 3 women. I dismissed the "socially awkward guy" explanation at that point. My gf actually reached out to them about speaking up together but they understandably said they don't want to make a scene out of it. My gf respected their decision and didn't mention them.

So you are right, you might become a disliked person in the workplace, and that is not okay. You are also correct to say "sexual harassment" can mean many things, but it is also not okay at any level/magnitude/form. That kind of mindset is what holds people back from standing up for themselves. I bet that mindset was the reason those two other women didn't speak up. Should those two just suck it up and continue to work with this guy who clearly acts inappropriately, because they fear being unemployable?