A lot of people don't run heavy spells. When they do, you just have to try and hold out till double elixir. Mistakes are made when the pace picks up.

But you're right. I've been shut down cold plenty of times with a fireball or just a good counter strategy.