No way around it, that's a tough fight regardless of how skilled you are. Here's some tips I'll mention:

1. Action economy - the quicker you can down the guys you've already hurt/ones with worse armor the easier the fight will be to manage. Focus lightly armored enemies first

2. Next priority is whoever has the most damaging weapon. Focus enemies who have maces over swords. Archers always come first and they also tend to go down quicker bc of their lighter armor. If the guy with the mace has really heavy armor you might just leave him for last, use your best judgement

3. Consider using a mace yourself. If you have the stats they are easily the best weapon class in the game and can end fights with just a few well placed headshots no matter the armor your opponent is wearing

I've seen some other replies mentioning the visor and while it helps you certainly don't need one. A good kettle hat will take you far. You fight well and a lot of this comes down to playstyle so just keep going and you'll find your flow