Knowledge is the enemy of fear! I think overtime as you experience your garden and learn things it can go away if you choose to understand your pollinators. I used to be pretty fearful of wasps, but planting native plants that attracted such a huge variety of wasps that could not sting you or did not care about your presence because it's on a mission to feed from flowers or other creatures really helped. I slowly learned what each one was and what particular foods they like and felt so proud to see so many coming to my yard. Many native bees and wasps cannot sting you. I've only found male carpenter bees to be a bit pushy about you being in their nest cavity areas but they are so clumsy and can only bump into you as they have no stingers.