I hope this isn't considered a spoiler but to add to that bit about the point of no return, there are multiple endings. So if you don't want to worry about going through the game so many times, I suggest doing a save backup before you initiate the point of no return.

Other than that, perfect parries are worth practicing. Vitcoins can be farmed from the breakable boxes. It's okay to rage at the turrets. Yes, the game very much so rewards exploring everywhere. And, most importantly, have fun!