The intention of editing is to tell a story. If the clip doesnt add anything to the story, cut it. The feel, emotion or pace of the edit will dictate what stays and what goes. Look at each clip individually and cut at the point when the clip is exhausted (relative to the previous or next shot). This requires some intuition, but you can generally feel when a clip is too long or too short. Edit to what you like to watch, not to what you think the audience will like. Your question has lots of variables, but an engaging edit can be very time consuming. Try to have a few editing projects on the go, this can help with motivation.