General Smith was instrumental in advancing a campaign, begun by a contribution of five dollars from a freed slave, Charlotte Scott, towards the erection in 1876 of the
Freedmen's monument in Washington, D.C., in memory of
President Lincoln. General Smith remained active in business, veterans' affairs and Republican politics, although he lost much of his wealth in the
Great Chicago Fire of 1871. After his friend,
Rutherford B. Hayes, was elected president, Smith became one of Hayes' unofficial advisors. He was named Chief of the Appointment Division of the Treasury department, where he oversaw all matters pertaining to the department's personnel, including dealing with candidates for Treasury offices. After his service in the Treasury Department, he was appointed Paymaster in the regular army with the rank of Major on April 17, 1878. He served for a year in Washington, during which time he testified at
West Point before the special commission investigating the case of
General Fitz John Porter. where he served until September 1882. Major Smith retired from the army on March 24, 1883, at the age of sixty-four, and settled in California. ==Death and legacy==