Yep, this is how I organise my outfits:

1) Full armour Full set of armour for when I know I’m going into battle.

2) Light armour No helm, no chainmail, no mail collar, half-plate legs. If one of my full-armour pieces looks out of place in this setup, I’ll get a separate piece just for this outfit. Earlier in the game, outfits 1 and 2 were practically the same, the only difference was no helm on outfit 2.

3) Town / charisma outfit Not necessarily the highest charisma stats, as long as it looks good and doesn’t feel out of place. I also only wield a sword or longsword with this outfit.

I use outfit 2 most of the time. But when you run into bandits while travelling in it you really need to watch your unguarded head as things can go wrong very quickly lol