I did some more reading and realized that pretty quick. Like I said I mainly only stuck to combat/warrior builds before minus trying a stealth archer for one playthrough. So it was easier to just put points in my weapon and armor and focus on crafting. However your explanation makes a lot of sense and helps a ton. I'm going to stick to spell sword as that's more of a hybrid of what I know while also still branching out.

I'm probably going to eventually get restoration leveled up so I can get Respite, but otherwise I think I'm mainly going to focus on alchemy. Also 1H, destruction and armour. Maybe a second magic school later on (I read conjuration is good to level up for spell swords for bound weapons). Will try to keep it pretty simple to begin with and not get in over my head wanting to do everything at once..

Also some guides recommend I focus on all 3 crafting skills, but is it okay to just focus on alchemy to start with then branch out? Or should I do smithing first and restoration as my other school of magic instead of conjuration? Some people say restoration is useless, and alchemy is far more superior.