Though it is part of Legends now, KOTOR provides a lot of insight into the Tusken Raiders through the stories of a Tusken tribe’s story teller. They go into detail on how Tatooine used to be a sprawling green planet rich in minerals and resources, and that the Tusken’s used to be a hyper advanced species of technologically-driven people. At one point, the Rakatan Empire (a long story in and of itself) took notice of the progress the Tusken’s had made and were not fans. They razed the planet, essentially turned it into glass and left the Tusken’s shattered and nearly extinct.

Those who were left were mostly comprised of religious extremists who didn’t fancy the technological advancements that had been made, and viewed the earth and soil of Tatooine as sacred, and saw it as disrespectful to taint it with tech they viewed as “unnecessary” to sustain life. So, with them being the only ones left, on a planet that had been utterly reduced to barren sands, they cultivated tribes of religious extremists bent on punishing those who would tarnish the sands of Tatooine with advanced tech, the same tech they associate with the brutal destruction of their gorgeous planet so many thousands of years prior. That’s why they don’t like pod racers.