Steven Rosen of
American Songwriter said that "You Can't Be Too Strong" was "maybe his greatest song, is the equal of
Costello's '
Alison' or anything by
Dylan."
Stephen Thomas Erlewine of
AllMusic describes the song as one of the two "centerpieces" of
Squeezing Out Sparks, alongside "
Passion Is No Ordinary Word". Erlewine writes that the two songs "indicate that [Parker's] traditionalist musical tendencies are symptomatic of a larger
conservative trend. But no one ever said conservatives made poor rock & rollers, and Parker's ruminations over a lost past give him the anger that fuels
Squeezing Out Sparks, one of the great rock records of the post-punk era."
The New York Times dubbed the song "a gripping retelling of an abortion," while
Trouser Press described the song as "a ballad full of disturbing imagery and emphatic phrasing which echoes the album title's judgmental metaphor."
Blues Magazine called the track "fantastic" and "insanely beautiful." The song's take on abortion has resulted in its appearance on ''
National Review's'' "Top 50 Conservative Songs" list. In the article, John J. Miller writes, "Although it's not explicitly
pro-life, this tune describes the horror of abortion with bracing honesty." Parker said of the song's appearance on the list, "I guess you can take what you want from it..." ==Cover versions==