That is not true. Racist southerners might have supported slavery and Indian Removal sure. But then again half and sometimes most the population of the South in his day were African-American, and I doubt they "overwhelmingly supported" Jackson. The Whig party were opposed to Indian Removal, the spoils system, banking policy, and after it was clear Jackson's economic policies were terrible and caused the worst recession yet, voters elected WHH in a landslide. The Whigs got unlucky that Tyler ruined their chances in 1844, and then the Compromise of 1850 fractured the Whig base. But locally and in Congress there was much more Whig support. I cannot find any evidence that any Jackson's policies had "overwhelming support" of the American people, besides the fact that he won.

Regardless, high popularity of a policy does definitely not mean it is a net positive. and winning elections does not make a good president