"What's the Matter Here?" was the third single released from 10,000 Maniacs' 1987 album In My Tribe, following "Peace Train" and "Like the Weather." A live version with lead vocalist Mary Ramsey was also included on their 2016 album Playing Favorites.