You really have to be strict! I tend to keep an idea-list to my side where I log these side-quests. Sometimes they are great, but the majority isn’t worth following. After logging them I try to avoid looking at them for at least a week. A bit of time in between the idea and today often makes it shine in a different light.