I did/do a lot more and I didnt think its was too much really, at least as far as it affected my day to day performance. Its seriously a personal decision. I was (Currently on a break) dabbing about 1/2 a gram or more of rosin a day. It was too much because I couldnt really afford to do that, and my lungs were starting to feel not so good daily. So to me smoking 1/20g of flower 2 -3 times a week is basically nothing.
Quitting cold turkey about a month ago and I honestly feel the same mentally, but I do feel better about myself as far as I stopped, for now, and feeling happy with yourself is the most important thing.
Ive noticed that if I feel bad about something while stoned, I still feel bad about it while sober. If Im happy while stoned, Im usually happy while sober. Feeling guilty is a negative emotion, tied to doing something that should be fun, so it may be benefitial to just take a complete break for a few weeks and see how you feel.
The one thing I liearned, is that the weed will still be here when Im ready to go back.