After retiring from the Regular Army in 1970 Magee accepted the position of Executive Director of the
Sydney Cove Redevelopment Authority. As such, he was in charge of a $300 million redevelopment program at
The Rocks, a slum district of historical value that was the home of many low-rent tenants. In what became known as the Battle of the Rocks, he was opposed by local residents and the powerful
Builders Labourers Federation (BLP) led by
Jack Mundey and
Bob Pringle, who imposed
green bans on the site until the BLF was deregistered in 1974. In the end, many historic buildings were saved, but the nature of the area was completely changed, and it was transformed into an up-market tourist attraction. In 1970, about 25,000 people visited The Rocks each year; forty years later, it attracted 9 million visitors per annum. Magee had memorials erected honouring people that had played a significant part in the history of
Sydney Cove, such as
George Barney,
William Bligh,
Robert Campbell and
Lucy Osburn, but opposed plans to build a monument to Jack Munday. Magee resigned in 1985 over a conflict with
Bob Carr concerning the redevelopment of Globe Street and the Clocktower in The Rocks. In retirement he did volunteer charity work, and served as Honorary Colonel Commandant of the Royal Australian Engineers. He remained active in debates on matters such as the proposed privatisation of the Snowy Mountains Authority, the
Very Fast Train between Sydney and Melbourne, which he felt would be uneconomical, and the design of the
Museum of Contemporary Art. He wrote a book on the Battle of the Rocks, titled,
How The Rocks Was Won. Magee died on 14 May 2007. He was survived by his wife Beverly and sons Tom and Jeremy. ==Decorations==