The Kingsbury Manx emerged in 1999 from the same North Carolina indie rock scene that spawned the Archers of Loaf and Superchunk before them. Band members Ken Stephenson (guitar/vocals), Bill Taylor (guitar/vocals), Ryan Richardson (drums/vocals), and Scott Myers (bass/keyboards) attended middle school together in Greensboro before going separate ways during their college years. Stephenson and Myers enrolled in creative writing studies at Wilmington while Taylor and Richardson both landed at UNC, Chapel Hill. During visits back home, the quartet began writing and recording the music for a demo. The band's break came when Overcoat Records owner (and former Thrill Jockey employee) Howard Greynolds heard the tape and agreed to fund their debut.

Kingsbury Manx was released by the label in 2000 to so little fanfare (failing to offer any information about the band or the recording) that it ended up creating a small amount of mystery. Managing to stay independent from any particular scene, the band cultivated a sound simultaneously derivative and original. The influences were timeless (early Pink Floyd, Simon and Garfunkel, the Beach Boys, and the Byrds have all been cited), but they were handled with such loving care and attention to detail that they were rendered largely insignificant. The album became one of the underground indie successes of 2000, landing in the year-end polls of the NME (Top 50) and Magnet ("Ten Great Albums Buried in 2000"). A short tour of the U.S. followed in support of Elliot Smith. Let You Down followed in 2001. It's Japanese counterpart release included two bonus tracks, "Dirt and Grime" and "My Shaky Hand." In support of the Afternoon Owls EP, which arrived in fall 2003, Kingsbury Manx toured with Sea and Cake. Additional shows with Gorky's Zygotic Mynci coincided the release of the band's third album, Aztec Discipline (2003). In 2004, the band started working on tunes for their next album at their practice space (Pine Manor) in Chapel Hill. They traveled up to Michigan to record the tunes atKey Club studios and, in early 2005, left longtime label Overcoat Recordings to sign with local North Carolina label Yep Roc Records. The band took the Key Club tapes to Chicago, where Wilco member Mikael Jorgensen mixed the album. The result was their 2005 release The Rise And Fall Of The South.