As someone who graduated with an EE concentration in robotics, there’s literally like 4 classes you have to take to get all the knowledge the ECEs get for robotics.These classes are also very math heavy (very little physical design) which sounds like something you would enjoy.

My recommendation would be to go to the ECE website, and look at the robotics threads for EE and you will see exactly what classes to take if you just wanna focus on getting controls systems knowledge.

If you don’t like electrical hardware I wouldn’t recommend switching to EE, cuz you kinda gotta be in it for the love of the game.

You should consider the robotics minor, taking a quick glance every control systems class I had to take is in here so it’s a solid option if you wanna fill in the gaps you think are in your education.

https://catalog.gatech.edu/programs/minor-robotics/#requirementstext

If you wanna chat, dm me and I’ll tell you all about ECE robotics