Waller was born in 1762 or 1765, the eldest son of
John Thomas Waller, MP, of Castletown and Elizabeth Bolton of Clonrush, Queen's County. Waller was educated at Harrow 1775–6; and matriculated from Trinity, Dublin 17 Apr. 1779, aged 17. He was further educated at Lincoln's Inn 1783. He married Isabella Sarah Oliver, daughter of
Silver Oliver, of
Castle Oliver, and grandaunt of
William Silver Oliver. Silver Oliver was MP for Limerick from 1768 to 1783. Waller was a descendant of
Hardress Waller MP for County Limerick from 1639 to 1661. Waller was also Sheriff, Co. Limerick 1792–3. ==Political life==