Allmusic's Thom Jurek wrote, "There are hints and traces of the lyrical genius Coe would display later, but taken as a whole,
Penitentiary is thoroughly enjoyable as a rowdy, funky, and crude blues record full of out-of-tune guitars, slippery performances, and an attitude of 'fuck it, let's get it done and get it out,' which was a trademark of
Plantation Records during the era." ==Track listing==