He was married to
Agnes Y. Aggrey-Orleans (née Bartels), a fellow diplomat. The couple had 2 sons, James E. K. and B. L. Kweku Aggrey-Orleans. He was a lifelong
Methodist. He was an external patron of Club UK, a social organisation for Diaspora Ghanaians from the United Kingdom. Aggrey-Orleans was also a
Freemason, belonging to the District Grand Lodge of Ghana of the
United Grand Lodge of England. His contemporaries in the
Masonic Lodge include diplomat,
K. B. Asante and the jurist and judge,
V.C.R.A.C Crabbe, Otumfuo
Osei Tutu II, the
Asantehene, the Grand Patron of the Grand Lodge of Ghana; and former
President of Ghana,
John Agyekum Kufuor, the Senior Grand Warden of the United Grand Lodge of England. == Death and funeral ==