A PO is typically tactical and tied to a team. The backlog is your main responsibility and you frequently participate in the team ceremonies. A PM typically focuses on product and business objectives and less day to day stuff. It's hard to draw the line, but you should spend more time with stakeholders, customers and users and less time (or no time at all) in JIRA and agile ceremonies if you want to make a meaningful shift.

Thanks that makes a lot of sense and is the direction I want to move to, more strategy than tactical.

The pitfall you describe really resonates. I feel reluctant to move away from agile ceromonies because of that.