Whitbread married Lady Isabella Charlotte Pelham, youngest daughter of
Henry Pelham, 3rd Earl of Chichester on 9 July 1855. They had four children together,
Samuel, Maude, Henry, and Francis. His eldest son, Samuel Howard, followed his father into politics. Maud married her cousin Charles, son of Samuel's younger brother William. Henry married Mary Raymond and lived at
Norton Bavant, Warminster. Francis married Ida, daughter of
Charles Hanbury-Tracy, 4th Baron Sudeley, and lived at Burford House,
Tenbury Wells. ==References==