Capers returned home after the Civil War. In December 1865, he was elected
Secretary of State for South Carolina. Ordained as an Episcopal Priest in 1868 he was rector of
Christ Church (Episcopal) in Greenville while also teaching at Greenville Military Academy, Greenville Female Academy and
Furman University. In 1875 he became minister of St Johns Church in
Selma, Alabama, and after a year returned to Christ Church in Greenville; in 1887 he was called to Trinity Church in
Columbia, South Carolina. He was elected Coadjutor Bishop of South Carolina and was consecrated on July 20, 1893. He became the diocesan bishop, the third bishop of South Carolina, in 1894. He served as the Episcopal Bishop of South Carolina from 1894 to his death, he also served as chancellor of
Sewanee: The University of the South from 1904 to 1908. He served on the board of the
John F. Slater Fund for the Education of Freedmen. In 1859 he married Charlotte Rebecca Palmer, a relative of
Francis Marion; they had 5 children. His sister Mary was the first wife of Major Peter F. Stevens, a fellow SCMA Professor who was Superintendent 1859–61 and also later an Episcopal Bishop. Bishop Capers died in
Columbia, South Carolina, in 1908 and is buried there at
Trinity Episcopal Churchyard. ==Honors==