Withers married Mary Ann Price on March 25, 1863. They had two children,
Eugene and Daniel Price. His wife died in childbirth in January 1869. Withers married his sister-in-law Lemma Price on December 6, 1875. They had four children, Daniel Price, Mary Stokes, Elijah Benton Jr. and Anna Gertrude. Withers was a member of the Mount Vernon Church and was a
Methodist. Withers died on April 23, 1898, at his home in Danville. He was buried at Green Hill Cemetery. ==References==