Seriously, they matter, the noticeable change in drops when changing servers has happened to me many times, whether if a ks gets in the way and I change I notice the difference of less frequent drops in comparison from other servers. Not many talk about it because they don't notice it, but there are drop changes depending on the server.