His family has a long association with
Kingsdown and Torry Hill, near
Doddington, Kent, where he rebuilt the family mansion in the 1960s. It features a striking view north towards the
Isle of Sheppey,
the Swale and the
Thames estuary. On the grounds of the estate, there is also what is believed to be the only
Eton Fives court attached to a private dwelling; it was built in 1925. Lord Kingsdown's father also built a private miniature railway in the 1930s. This still runs for several miles on his estate. One of his sons,
James Leigh-Pemberton, continues the family's association with the
Duchy of Cornwall (beginning with its Chancellor,
the 1st Baron Kingsdown) as Receiver-General. His brother Jeremy Leigh-Pemberton was a deputy lieutenant of Kent, and was the parish chairman for the neighbouring parish of
Wormshill. Another brother is the opera singer
Nigel Douglas. ==Arms==