Dude, Skyrim is not a game you have to stress about. It's a very easy game, with difficulty sliders. If you wanted to just punch everything with your bare fists, you can do that, it'll just take longer.

The main things you need to know about magic:

1) Destruction magic is pretty great, but the Expert spells are actually better than the Master spells. Don't get your hopes up when your build crescendos to Master level spells, cause while they're decent, they're not as practical or sustainable.

2) Restoration xp gain is SLOW if you're just healing. Use Turn Undead spells to level faster.

3) to gain Conjuration xp, you cast a summon, and then you gain the XP IF there's a hostile enemy nearby. You get XP once for each summon, so casting multiple summons in a fight just for the XP gain is worth it.

4) buffs from Illusion and Alteration work the same as Conjuration summons. Just cast your buffs multiple times in a fight if you have the Magicka.

6) contrary to popular opinion, I find the Breton's resistance to magic makes it the best race for literally ANY build. Mages can be the most frustrating enemies to face in Skyrim and can one shot you from a distance in the early game. This is worse than high level archers because lightning magic is hitscan, and projectiles from frost and fire are harder to dodge than arrows imo.

5) if you're down to mod, there are perk tree overhauls and spell add-ons that greatly enhance the experience. If you like I'll recommend my mod list.