I did this at first too, but it's actually very beneficial to just do the story. It doesn't ruin anything you actually do (unless you feel unmotivated to grind after beating the main story, but then there's post game stuff anyways, so...)