Kemp trained for ordination at
St Stephen's House, Oxford, from 1936 to 1939 where he later chaired the house council. He was made deacon on
Trinity Sunday (4 June) 1939 and ordained priest the following Trinity Sunday (19 May 1940), both times by
Cyril Garbett,
Bishop of Winchester, at
Winchester Cathedral. He was assistant curate of St Luke's Church in
Newtown, Hampshire, from 1939 to 1941. He moved back to
Oxford, where he remained for almost 31 years, first as priest librarian of
Pusey House (1941–1946) and chaplain of
Christ Church, Oxford (1943–1946) and then as fellow, tutor and chaplain of
Exeter College, Oxford, from 1946 to 1969. He was dean of
Worcester from 1969 to 1974 and
Bishop of Chichester from 1974 to 2001. Kemp was consecrated as a bishop on 23 October 1974 by
Michael Ramsey,
Archbishop of Canterbury, at
Southwark Cathedral. This took place before the introduction of a mandatory retirement age, so Kemp was able to continue in the post for as long as he chose. As a result, on his retirement he was one of the oldest and one of the longest-serving diocesan bishops in Church of England history. He had also held subsidiary appointments as
Chaplain to the Queen (1967–1969) and canon and prebendary of
Lincoln Cathedral (1952–2001). In April 1998 he was appointed a ''chanoine d'honneur'' (canon of honour) of
Chartres Cathedral. Following his retirement he was made Bishop Emeritus of Chichester. ==Family==