In 1951, Palmer moved to Lexington, Kentucky and opened his first pharmacy,
Palmer Pharmacy, in the East End, a traditionally Black neighborhood. It was a franchise of
Rexall, the company's first Black owned store. He was actively engaged in mentoring neighborhood youth, employing them and referring them to other businesses. Palmer was instrumental in founding a student branch of the
American Pharmaceutical Association at Xavier serving as the first president. He also was a writer for the student newspaper, the
Xavier Herald. Palmer, his wife, and four-year-old daughter, Andrea, were hospitalized after being trapped under the rubble for hours. In 1970, Klansman Phillip J. Campbell of New Albany, Indiana, was convicted of this crime after a 90-minute deliberation by an all-white, all-male jury and sentenced to 21 years in prison. He also pleaded guilty to a car bombing in
Louisville, Kentucky. Palmer continued his involvement in the community, including the UK Board of Trustees (1972–1979) to which he was appointed by
Governor Wendell Ford. His Fifth and Race building is now the property of city government, which once considered razing the building. However, activists and historic preservationists have fought to allocate funds to preserve the building. An effort is underway to place the building on the
National Register of Historic Places. == Personal life and death ==