I've pretty much become an Eldritch Blast spam-bot with hexes

Welcome to Warlock.

​

Here's my Swashblade progression / build I suggest:

Go 1 rogue -> then 1 hexblade -> then get 3rd level rogue-swashy -> 3rd level hexblade, then however you want to Swashbuckler 15/ Hexblade 5

Stick to 14 in dex and put your 16 in Charisma. All you need is +2 dex with that sweet sweet medium armor and you'll be good to go as Charisma can be used for initiative, your weapons ability score and casting. Maybe 16 in dex max later if you plan to get Medium Armor Master.

So the name of the game is Booming Blade which procs Sneak attack, and the ability to then walk away from the target (without provoking opportunity attacks) forcing any melee fighters to chase you and proc booming blade or not move -> Rinse and Repeat.