In a retrospective review, Justin Chadwick from Albumism called the song "unforgettable" and "pure pop perfection". He added, "Regardless of where you ultimately netted out with respect to your overall opinion of
P.M. Dawn, if you're like me, you were hooked the first time you heard the pop-infused brilliance of 'Set Adrift on Memory Bliss'." Steve Huey from
AllMusic described it as a "shimmering"
ballad. Another AllMusic editor, Hal Horowitz, named it an "amazingly mature debut tune." Upon the release,
J.D. Considine from
The Baltimore Sun felt that "they create entirely new grooves out of half-remembered song-bites, like the slice of Spandau Ballet's 'True' that crops up in 'Set Adrift on Memory Bliss'. A pleasant surprise." Dave Sholin from the
Gavin Report wrote, "Hypnotic
rap from
New Jersey brothers
Prince Be and
DJ Minutemix [...] not only brings back a memory or two, it's sure to create new ones. It has fresh production elements and a
chorus with all the relaxing, calming qualities of a nice long massage. A massive hit overseas, it's set to become just as big in North America thanks to early airplay at key
crossover outlets."
Everett True from
Melody Maker said, "I rather like it—its melding of new age hippychick to old age romantic makes for rather a nice laidback groove and a sure-fire smash." Alan Jones of
Music Week named it Single of the Week, commenting, "A brilliant soundscape starts with some nice vocal work, followed by the drum track from
Dennis Edwards' '
Don't Look Any Further' before Spandau Ballet's 'True' leads into a mellow rap. A serene summer smash." A reviewer from
Newcastle Evening Chronicle described it as a "dreamy rap song". Johnny Dee from
Smash Hits named it Single of the Fortnight, calling it the "dreamiest, most laid-back record ever invented." He added, "Quite what lyrics like "rubber bands expand in a frustrating sigh" mean is a total mystery, but if ever a record could be described as — aherm — like being massaged by a bag of
marshmallows, then this is it. Melt city!" While reviewing
Of the Heart, of the Soul and of the Cross: The Utopian Experience, the magazine's Gary Kipper stated that the song "is, of course, one of the most summery records ever made". Jonathan Bernstein from
Spin wrote, "The hit track, the play track, the ultimate "Huh?" inducer, 'Set Adrift on Memory Bliss' is a classic of languid lassitude. Deadpan as
De La doing '
West End Girls', 'Memory' opens with a laconically drawled "
The camera pans the cocktail glass behind a blind of plastic plants" and just gets better from there." ==Impact and legacy==