The Downer family have played a prominent role in South Australian and Australian politics. Their earliest ancestors were Mary Ann Downer (1792–1868) and her son Henry Downer, a tailor (1811–1870), who travelled from England to Australia in 1862, settling in Adelaide.