The Anglican church built a
rectory on the site in 1853. In 1889, the church converted that building to a
deanery. After serving as a chaplain to 300 convicts, Reverend
Joseph Winters lived in the residence as he served as the chaplain in Bunbury from 1864 to 1889 and again from 1889 to 1893. He is credited with initiating the fundraising and building of
St Paul's Anglican Church on nearby Victoria Street. The church decided to sell the structure in 1954 due to
water damage. The Bunbury Women's Club began in 1955, led by a female relative of Reverend Withers.{{cite web |url=https://inherit.dplh.wa.gov.au/Public/Inventory/PrintSingleRecord/5e6ebd96-ffbf-4e4b-b70c-ffb9dd5c5df4 |title=Bunbury Women's Club |author=
City of Bunbury |date=23 January 2018 |website=inHerit Western Australia's State Register of Heritage Places listed the building on an interim basis in 2012, which became permanent the following year.
Lotterywest then began funding conservation work on the structure. In 2016, the building began plans to join the Bunbury's Heritage Trail, part of the
Western Australian Heritage Trails Network. == Architecture ==