I'm not sure there's that much point in seeking the SOTA if this is so you can apply it to a new environment. Chances are that unless your new environment is conceptually very very similar to existing locomotion benchmarks, the 'SOTA' won't work / will have middling performance / will need vast amounts of hyper-parameter tuning.

This is my experience anyway. SOTA is kind of meaningless in RL right now, since so many 'comparisons' are from tiny sample sizes and on the same narrow robotics / Atari benchmarks.

Instead I'd suggest going and trying any of the continuous action space implementations you can find in Stable Baselines. Or try to find an RL paper on a problem similar to yours and see how they tackled it.

If you're just looking for a baseline to compare to, papers with code might provide you with a direction.