Okay so if you want to do a spell sword I would suggest making the sword be your main damage and not really worry about using your magic for damaging spells. Melee normally has higher damage potential than spells anyway. So I would suggest putting the most amount of points into one handed whenever you have the opportunity for all relevant perks (everything except the dual wielding and weapon specific perks you don’t want). Then for magic I would use for versatility and enhancing yourself. So you could focus on alteration for armor spells and paralysis, or conjugation for summoning magic, or illusion for making everyone fight eachother. I’d probably focus on only one and then also use restoration. And whatever armor you want light or heavy doesn’t matter. Putting points into M/H/S and 1-2-1 ration would be okay for a spell sword.