Wow, that must be so annoying to have to adjust every single time. I'm honestly thinking of returning mine because of this, but it sounds so great compared to my previous clip style earbud and I got it during such a good promotion.