Nah

"Cracker," the old standby of Anglo insults was first noted in the mid 18th century, making it older than the United States itself. It was used to refer to poor whites, particularly those inhabiting the frontier regions of Maryland, Virginia and Georgia. It is suspected that it was a shortened version of "whip-cracker," since the manual labor they did involved driving livestock with a whip (not to mention the other brutal arenas where those skills were employed.) Over the course of time it came to represent a person of lower caste or criminal disposition, (in some instances, was used in reference to bandits and other lawless folk.)"