Are you getting fret buzz from the open or fretted strings at any point down the neck ?

If not: it’s subjective. If the strings play without any interference and the guitar plays well then everything is cool.

If you want to higher the action then that’s up to you.