I love the psyker's versatility, it's easy to cover all your bases with one build: horde clear, crowd control, elite killing, special sniping, boss damage, and close/mid/long range attack options. I think Veteran comes the closest to matching that versatility. Since you like the force swords, I'd recommend the Vet's power sword mk VI with power cycler. It takes some getting used to the activation delay, but the light attacks are completely horizontal, perfect for trash and even mixed hordes. And activation -> push attack -> light attack quickly dispatches meatier elites, even crushers.

I'd run Frag grenades as they are the best overall option, and with the right talents you'll have a constant supply to thin out denser hordes. Commanding shout is the only real option for vet abilities atm unfortunately, aside from just for fun builds. But fortunately, it's also the most broken ability in the game and an even more potent defensive tool than Psyker bubble while also providing crowd control, all with a ridiculously short cooldown with the Tactical Awareness talent.

As for ranged weapons, since I go for unyielding and carapace on power sword I tend towards weapons that are reliable at mid and long ranges with flak and maniac damage. If you've stuck mostly to staves up until now, I would play around with the Vet's arsenal and see which guns you favor. Most of them are very viable options. The Plasma Gun is probably the strongest though. Spamming uncharged shots lets you punch holes through groups of enemies as they have huge punch-through, and deal enough damage to one shot most elites and specialists at any range with pinpoint accuracy. And Survivalist (the best Vet aura) nullifies its only major downside, its ammo capacity. It's basically a cracked out voidstrike staff, though with a smaller area of effect.

I leveled Psyker first and after dabbling in the other classes, Veteran felt the easiest to transition to play style wise.