On 7 September 1761, Ogle married Hester Thomas at
Bremhill,
Wiltshire. She was the daughter of Susan Muslo and
John Thomas,
Bishop of Winchester. His brother Newton married her sister Susanna. Together, they were the parents of: • Arabella Ogle (1762–1855), who married Hon.
Edward Bouverie, son of
William Bouverie, 1st Earl of Radnor, in 1785. After his death, she married Hon. Robert Talbot, son of Col. Richard Talbot and
Margaret O'Reilly, 1st Baroness Talbot of Malahide, in 1828. Sir Chaonler died at his seat at
Worthy on 27 August 1816. He was succeeded in the
Baronetcy by his son,
Charles.
Descendants Through his daughter
Barbarina, he was a grandfather of author
Arabella (née Wilmot) Sullivan (1796–1839), who married Rev. Frederick Sullivan (fourth son of
Sir Richard Sullivan, 1st Baronet),
Vicar of
Kimpton, Hertfordshire, parents of
Barbarina Grey, Lady Grey and
Sir Francis Sullivan, 6th Baronet. Through his son Charles, he was a grandfather of Captain Sir Chaloner Ogle, 3rd Baronet (1803–1859), who married Eliza Sophia Frances Roe, parents of Sir Chaloner Roe Majendie Ogle, 4th Baronet (1843–1861), who died unmarried at age 18 and was succeeded in the baronetcy by his younger half-brother Sir William Ogle, 5th Baronet (1823–1885), who "had been an invalid from his cradle". Through his youngest son James, he was a grandfather of Gen. Sir Edmund Ogle, 6th Baronet, colonel-commandant in the
Royal Engineers, who married Catherine St Hill and was the father of the last two baronets, Sir Henry Asgill Ogle, 7th Baronet and Sir Edmund Asgill Ogle, 8th Baronet, neither of whom married, thus rendering the baronetcy extinct upon the 8th baronet's death in
San Remo, Italy in 1940. ==Portraits==