On 11 October 1950 Plymouth married Caroline Helen Rice (1931–2016), daughter of Edward Denis Rice (1899–1973) and Grace Lucille Marcella Duggan (1907–1995), daughter of Alfredo Huberto Duggan (1875–1915) and his wife
Grace (née Hinds), later Marchioness Curzon of Kedleston. They had four children: • Ivor Edward Other Windsor-Clive, 4th Earl of Plymouth (born 19 November 1951), married Caroline Anne Nettlefold, daughter of Frederick Nettleford and Juliana Eveline Curzon, a daughter of
Richard Curzon, 2nd Viscount Scarsdale. • Lady Emma Windsor-Clive (born 13 February 1954) •
Hon. Simon Percy Windsor-Clive (born 19 November 1956) • Hon. David Justin Windsor-Clive (born 4 September 1960) ==Death==