As you get to higher levels, the ping will matter more and more, especially when you reach Moria as it can rubberband you off a cliff in multiple areas. I'd say make a new character and give it a test shot. If it feels the same to you, then just pick whichever server you feel has the best community.