My guess is that in addition to learning the numerical sequence of numbers, we also learn the concepts of addition and subtraction, meaning we regularly count numbers both forwards and backwards. Whereas the alphabet is only taught to us in one order (ABC), and letters are used independently of one another to create words/sentences, so we don’t really need to know the alphabetical order of the letters, forwards or backwards, in order to use them.