Babington was born in County Cork in 1920 to Oscar John Gilmore
Babington (1879–1930), also an Army officer, and his wife Annie Honor Wrixon (1878–1975). Among his cousins were Sir
Anthony Babington and
Robert Babington, a recipient of the
Distinguished Service Cross. In the early stages of his life, Babington grew up in India and England. However, Babington's father died of alcoholism when he was aged 10, so the family were forced to sell their estate in Cork. Babington, his mother and two siblings were continuing to live at Kenley Court, where they had been living in Surrey, in reduced circumstances, whilst Babington attended
Reading School, having originally been set to go to
Eton College. ==Military service==