In about 1835, Beman married Eunice Jeffrey, with whom he had three daughters and two sons: Mary, Amos, Fannie, Charles, and Emma. Their daughter Mary married
Richard Mason Hancock on July 20, 1856. Mary, her new husband, and her brother Charles moved to Lockport, New York. In August of that year, Amos's wife and son Amos died of typhoid fever. Six months later, their daughter Fannie died of
consumption. In 1858, Beman married Eliza Kennedy Howell, a white woman — a decision that drastically undermined his standing at the Temple Street Church. Eliza's first husband had been John William Howell, a man of color born in the
West Indies, and their daughters Eliza and Catherine Romena were listed as mulatto on census records. Both daughters married ministers in 1864: on 1 November, Eliza married the Rev.
Hezekiah Hunter, and on 20 December, Catherine married the Rev.
Francis Lewis Cardozo, who was the pastor of Temple Street Congregational Church and would go on to become South Carolina's Secretary of State. Eliza Beman died of cancer on 5 November 1864. Amos's son Charles served in the U.S. Army during the Civil War and died of consumption in 1875. Amos's daughter Emma lived in
New Haven, Connecticut, until her death in 1910. Amos Beman married a third time to an African American named Mary (née Allen), widow of Chester Thomas, but for most of his acquaintances, it was too late for Beman to atone for his decision to marry a white woman. ==Pastoral life==