Fernandez had six wives Princess Ibilola Lipede of
Egbaland was his first wife. Their daughter Olateju Phillips learned accountancy and served as the Commissioner for Commerce and Industry in Lagos State. and in 2018 married Xerona Duke, the daughter of Governor
Donald Duke. Folashade Bankole was Fernandez's second wife, the marriage producing Gbemi Fernandez and Anthony Fernandez. who married Fernandez in 1961 in Virginia, bore him three children in the U.S., separated from him in 1984 or early 1985, then filed for divorce in 1987. The offspring of this marriage are Akintokunbo Fernandez, Christina Titilola Unzicker and Adekoyejo Fernandez. After Barbara died in mid-2013, Fernandez was distraught and refused to celebrate his own birthday. Dosunmu and Fernandez were married in Nigeria at the Palace of the Oba in April 1973 in a ceremony attended by famous Nigerians including Admiral
Adekunle Lawal. They had one child, a daughter named Antoinette Oyinkansola Fernandez - a London-based writer and filmmaker who stood for a seat in Parliament in July 2024 as a Green Party candidate. Nigerian musician
King Sunny Adé wrote a song honoring Dosunmu titled "Biibire Kose Fowora". Fernandez and Dosunmu worked together to bring industry to Nigeria. When Fernandez was visiting in Lagos, he stayed with Dosunmu at the Tower Fernandez, which they built together. The marriage lasted fifteen years. In 2007, Dosunmu was publicly ordered by Fernandez to stop using his surname. His fifth partner was African-American Sandra Inett Price. She took the name Aduke Fernandez at their union, which she said began in 1982 with a tribal wedding in Nigeria, though at their divorce proceedings in 2003 he said they were never formally married. Two daughters were born of this union: Atinuke Fernandez in 1984, and
Abimbola Fernandez in 1989. On Abimbola's French birth certificate, Fernandez wrote that his own birth year was 1936, not 1929.
Lord Brodie presided over the case, which was eventually settled for 36 monthly payments of £30,000 totalling £1,080,000. Aduke died in 2013, after having reconciled with Fernandez, speaking to him on the telephone. The sixth partner of Fernandez was Halima Maude, once a beauty queen of
Kano. She was previously married, and had two children before meeting Fernandez. She remarried in July 2018, three years after the death of Fernandez. In addition to the various titles that he held in the
Nigerian chieftaincy system, Chief Fernandez was also the
Baron of Dudley in Scotland. He purchased this title for £59,000, and held it until his death. ==Death==