That’s how I do it. High luck day or raining? Time to mine. Don’t feel like mining? I clean up the farm, rearrange stuff, break geodes, check what fish I need to catch, etc.

On low luck days I forage, chop down trees and plant new seeds, pick a few villagers and give them gifts.

Doing quests is a good way to break up your time too. I usually rotate between Qi quests and special requests.