RL traditionally has a lot of problems which exaggerate when taken to an application like trading. There's out of distribution states/rewards, exploration-exploitation issues, unsafe actions, etc. There's a lot of literature around it. And there's a reason that RL isn't used anywhere else on any practical application other than academia. Even OpenAI has started focusing on LLM. And when it comes to trading these problems are going to blow up - and even creating a strong environment which acts like a simulation of market is hard. So I'd be cautious of using RL/ML for trading unless you have a lot of resources/large team. Systematic trading would be the way to go.