Potter married Laurencina Heyworth, daughter of Liverpool merchant
Lawrence Heyworth and his wife Elizabeth (née Aked), on 13 August 1844 at St. Mary the Virgin church in
West Derby, Lancashire. The couple had ten children: • Lawrencina (1845–1906), who married
Robert Durning Holt •
Catherine Courtney, Baroness Courtney of Penwith (1847–1929), social worker and internationalist • Mary Elizabeth (1849–1923) • Georgina (1850–1914), on 11 September 1873 she married Daniel Meinertzhagen, of Brookwood Park, Alresford, Hampshire, and 12 Tokenhouse Yard, London, he died 5 June 1910 at Brookwood Park. • Blanche (1851–1905) • Theresa (1852–1893), first wife of
Charles Cripps, 1st Baron Parmoor • Margaret Heyworth (1854–1921), who married
Henry Hobhouse •
Beatrice Webb, Baroness Passfield (1858–1943), social reformer • Richard (1862–1864) • Rosalind (1865–1949), mother of
Kitty Muggeridge. Almost all of Potter's children, in-laws, and grandchildren became well known. ==Standish House and The Argoed, Penalt==