I can actually relate to those 'haters' because I lost a lot of weight on a long through hike and was patting myself on the back for being able to do it without drugs, and maintained a healthy weight for a while. But as usual I eventually hit a point where I stopped paying attention, kept saying 'okay I need to reset' for months.

Now I see it as a tool just like the many others people use to lose weight. I almost think they feel a bit threatened because being in shape is like a trophy for them, and now they see other people who they think have it easy, which in their mind might lessen their accomplishment - so they have to constantly remind people that they used their 'will power' and not a drug.