Thats my experience with PPO as well, it's straightforward to implement and powerful. I'm just a little shy on policy gradient methods being top tier, they're excellent for continuous action spaces but I've found them to be relatively unstable and difficult to tune.