In 1808, he returned to Boston and married Elizabeth "Eliza" Perkins (1791–1885), a daughter of
Thomas Handasyd Perkins. Together, they lived in
Brookline, Massachusetts and were the parents of seven sons, including: • Thomas Handasyd Cabot (1814–1835), who caught
smallpox and died in China. •
Samuel Cabot III (1815–1885), a surgeon and ornithologist who married Hannah Lowell Jackson. •
Edward Clarke Cabot (1818–1901), an architect and artist who married Martha Eunice Robinson Cabot in 1842. After her death in 1871, he married Louisa Sewall in 1873. •
James Elliot Cabot (1821–1903), who became a philosopher and author who married Elizabeth Dwight in 1857. • Stephen Cabot (1826–1906) • Walter Channing Cabot (1829–1904), who married Elizabeth Rogers Mason in 1860. • Louis Cabot (1837–1914), who trained as an architect under his older brother before becoming a soldier in the Civil War and marrying Amy Hemenway. Cabot died on September 11, 1863. ==References==