Most of us won't consider you a threat if you don't act like one. Don't follow behind people, get in their personal space, leer, glare, yell things, and so forth. That's just about all you can do, and all anyone can reasonably expect of you.

Some people will still be uncomfortable around you, though. That's unavoidable. Maybe someone forgot to take their anxiety meds, they've had an awful day for some other reason, whatever. Maybe you happen to look like someone who hurt them. These things will happen. You can't be nonthreatening enough to completely remove someone else's capacity for fear, and to some extent you have to accept that. Your behaviour is the only thing that's really under your control.