The Natural History were a band composed of Tepper brothers singer–guitarist Max and bassist Julian, along with drummer Derek Vockins. After playing locally in the New York area and self-recording their own three-song EP, The Natural History caught the ear of local NYC label Startime International, whose roster includes Brendan Benson, The Walkmen, The French Kicks, among others. Recording with Greg Talenfeld at Stonehouse studio in Nyack, New York, the band released the finished product as a self-titled EP in July 2002. The EP was promoted with a year-full of touring with Enon and Spoon, whereupon the band also found time to record their debut full-length effort Beat Beat Heartbeat, which was released in May 2003.