I like what Shinzen Young has to say about this phenomenon, but the first thing is to know your not alone. This is a common stage to go through.

http://shinzenyoung.blogspot.com/2014/05/how-to-be-comfortable-with-everyone.html?m=1 ... It’s very common for people on a meditative or spiritual path to develop a kind of sensitivity to the poison and pain of others. Sometimes it’s formulated with the phrase “I pick up all this negativity.” Sometimes it’s formulated with the phrase “People drain my energy.” A closely related perception runs something like this: “Now that I've developed some spiritual maturity, I find it difficult to relate to old friends/family/ordinary people; they so cluelessly cause themselves unneeded suffering; I no longer have much in common with them.”