The Natural History were a band composed of Tepper brothers singer–guitarist Max and bassist Julian, along with drummer Derek Vockins. After playing locally in the New York area and self-recording their own three-song EP, The Natural History caught the ear of local NYC label Startime International, whose roster includes Brendan Benson, The Walkmen, The French Kicks, among others. Recording with Greg Talenfeld at Stonehouse studio in Nyack, New York, the band released the finished product as a self-titled EP in July 2002. The EP was promoted with a year-full of touring with Enon and Spoon, whereupon the band also found time to record their debut full-length effort Beat Beat Heartbeat, which was released in May 2003.

In 2004, The Natural History recorded a second album called People That I Meet, which was due in the spring of 2005; however, the band soon split from their record label Startime International, and the record's release was postponed indefinitely. Finally, after nearly two years of fishing for a new record label, the record was self-released by the band in November 2007. One of the songs that ended up on the album, "Don't You Ever", was covered by Spoon on their sixth studio album Ga Ga Ga Ga Ga. Spoon also included The Natural History's original version of the song on their EP Don't You Evah, which was released on April 8, 2008. Spoon included "Don't You Evah" on Everything Hits at Once: The Best of Spoon, released by Matador Records in July 2019. An article written for Playboy magazine by Julian Tepper includes a Q & A with Spoon's Britt Daniel, in which the Tepper brothers and Daniel recount the story behind "Don't You Evah".

After People That I Meet was completed in 2004, Derek Vockins left the band to raise a family. He was replaced with drummer Tim McCoy. The band also added a second guitarist, Brooklyn based John Caselli. The newly formed quartet toured the East Coast and Midwest in the Spring of 2005, and followed up that summer with a 3 week tour of England, Norway and Sweden. The new line-up never took wings, and the band dissolved shortly after.