Much of Fagg's time in Oxford was spent trying to raise funds for a new
Pitt Rivers Museum building in Oxford to replace the original building, but in the north of the city along the Banbury Road. The project, which ultimately failed, was to define Fagg's curatorship. However, Fagg was seen by many in Oxford as the right person to spearhead such an initiative. As a subsequent Curator of the Museum
Schuyler Jones said, 'there was a general feeling that the Museum had outgrown its first Oxford home and that two things were needed: an imaginative scheme for a new museum, and someone with experience and energy to guide it through to completion.' Other leading authorities were equally enthused by the prospect of the new scheme, with
Jaquetta Hawkes writing that: "It may be that of late the distinguished and enthusiastic curator, Mr Bernard Fagg, has been, if not deliberately adding to the sense of congestion, at least not officiously striving to relieve it. For there is now a glorious probability that a new Pitt Rivers Museum will arise in Oxford, a place where the marvellous collections could be properly spaced, well lit and in every way displayed in a manner worthy of their quality." Plans reached a considerable stage of advancement by the end of the 1960s with architectural drawings by
Pier Luigi Nervi and some high profile supporters. However the ambitious project was eventually shelved due to a lack of funding, as well as Fagg's own health issues following a stroke in May 1968. He retired from this post in December 1975. ==Legacy==