On 27 August 1853 at
Ghent,
Belgium, Broke married Albinia Maria ( Evans) Rushbrooke (1821–1905), daughter of Thomas Evans, after she had been divorced by her husband, Maj. Robert Frederick Brownlow Rushbrooke, on the grounds of her adultery with Broke. Broke-Middleton died at Shrubland Park on 14 January 1887, and the baronetcy became extinct. His Suffolk estates were inherited by a niece, Lady de Saumarez, formerly Jane Anne Broke, the daughter of his brother Capt. Charles Acton Broke (who had married Anna Maria Hamilton, daughter of John Hamilton of
Sundrum). In 1882, she had married
James Saumarez, 4th Baron de Saumarez, and the estates, including
Shrubland Park at
Coddenham, Suffolk,
Broke Hall at
Ipswich, and Livermore Park at
Bury St Edmunds in
Suffolk, The inheritance made Lady de Saumarez the largest owner of London real estate in the aristocracy outside of the
Duke of Westminster, which she held until the Middleton Estate, as it was known, was sold in 1921. ==References==