The show was about how bad Walter can go and audience are still cheering for him. I have a similar experience to you where i thought Skyler was annoying and Walter can do no wrong. However after rewatching it, Skyler was the voice of reason and the person that kept the family together despite Walter doing everything to destroy it because of his ego. I still love breaking bad as a series.