Irby was born on 8 March 1707. He was the only son of
Sir Edward Irby, 1st Baronet (1676–1718) and Dorothy Paget (d. ). His paternal grandparents were Anthony Irby (heir of
Sir Anthony Irby) and the former Mary Stringer (a daughter of John Stringer of
Ashford, Kent). His maternal grandparents were Hon. Henry Paget (second son of the
5th Baron Paget) and the former Mary O'Rorke (a daughter of Col. Hugh O'Rorke,
High Sheriff of Leitrim). His maternal uncle was
Brig.-Gen. Thomas Paget, the Governor of
Menorca. Through him, he was a first cousin of Caroline Paget, who married
Sir Nicholas Bayly, 2nd Baronet in 1737. On the death of his father on 11 November 1718, he succeeded as the 2nd
Baronet Irby, of
Whaplode and
Boston, Lincolnshire in the
Baronetage of Great Britain. After inheriting the baronetcy, he attended
Westminster School from 1719 to 1722. ==Career==