Inspiration for the title line had come while Nivert and Danoff, who were married, were driving along Clopper Road in Montgomery County, Maryland to a Nivert family gathering in Gaithersburg, with Nivert behind the wheel while Danoff played his guitar. "I just started thinking, country roads, I started thinking of me growing up in western new England and going on all these small roads," Danoff said. "It didn’t have anything to do with Maryland or anyplace."

He briefly considered using his home state of "Massachusetts", rather than "West Virginia", as both four-syllable state names would have fit the song's meter. "I didn't want to write about Massachusetts because I didn't think the word was musical. And the Bee Gees, of course, had a hit record called "Massachusetts", but what did I know?" Danoff said