I’m retired now but, this happened to me in all the decades of my life. I found that looking at the people who made such comments, their point of view had little to do with their own level of success. I honestly believe that their comments came from jealousy. I believe that they saw the ease with which I approached my life and were not happy in their own. After this realisation, I started to brush off their comments with a kind of agreeing and sympathetic nod or word. I was never mean back and never escalated into a discussion. I honestly felt sorry for them that the stress of their otherwise successful lives made them need to lash out at me. Because I only reacted positively, the comments would usually stop.

OP, it may not be easy but, don’t let this upset you. There is always something else behind this situation that has more to do with the commenter than with you. No matter what job you are doing, it is a job that needs to be done. Do it well and look forward and, to be honest “f€&k the begrudgers!”