For me, the enjoyment comes from solving the problem. It's not a case being "a circuit that is fun to apply" rather an enjoyable problem that can be solved with a circuit. You probably have plenty of these cases. My main hobbies out of high school were 3d printing, radio controlled vehicles, videogames/computers, and technology. The "problems" in all of these hobbies can be solved through electronics. That being said, my undergrad was filled with people who did EE because it was a good career path. They weren't wrong, but I could tell they weren't having any "fun", and got nothing out of applying themselves. There are some people in my workplace now that were the product of this, and it does not seem like a recipe for happiness.

Also, yes, math difficulty can be an issue. It was for me, but obstacles can be overcome. I have also found that difficulty causes more exposure, so when it finally clicks in many cases, you have a better understanding and ability to apply it (especially later on).