On 4 July 1835, he was married to Lady Louisa Lascelles, a daughter of
Henry Lascelles, 2nd Earl of Harewood and Henrietta Sebright (a daughter of Lt.-Gen.
Sir John Sebright, 6th Baronet). Together, they were the parents of six children: • Henry George Cavendish (1836–1865), who died unmarried. • Alice Louisa Cavendish (1837–1905), who married the Hon.
Algernon Egerton, the third son of
Francis Egerton, 1st Earl of Ellesmere (a younger son of
George Leveson-Gower, 1st Duke of Sutherland), in 1863. • James Charles Cavendish (1838–1918), who died unmarried. • Arthur Cavendish (1841–1858), who died unmarried. • Walter Frederick Cavendish (1844–1866), who died unmarried. • Susan Henrietta Cavendish (1846–1909), who married
Henry Brand, 2nd Viscount Hampden, the
Governor of New South Wales. Lord George died at
Ashford Hall, Derbyshire on 23 September 1880. ==Ancestry==