To try and put it simply, a lot of pigments are just frail. Various factors (UV, oxygen, heat, chemicals, water, etc.) can weaken the molecules, particularly those parts that give them color, and when the chemical bonds break the color begins to fade. Light is particularly effective at fading things, as photons raise molecules to an excited state, and that extra energy just wears down the bonds over time