Hugh was born at
Stratton Audley, the second son of
Hugh de Audley (c. 1267 – c. 1326) of Stratton Audley by his wife Isolde (Iseult) le Rous (c. 1260 – 1338), daughter of Sir Roger le Rous and Eleanor de Avenbury and the widow of Sir Walter de Balun. The 1st Earl had siblings including John de Audley (born c. 1293) and Alice de Audley (born c. 1304) who married firstly
Ralph de Greystoke, 1st Baron Greystoke and later
Ralph Neville, 2nd Baron Neville de Raby. ==Marriage==