In addition to his duties as a public servant, Swofford was a businessman, farmer, and postmaster, and was an active member in several social clubs in
Lewis County, Washington. He served as an auditor in the county beginning approximately in 1905. He quickly earned notoriety as the "most cussed and discussed man in Lewis County", once refusing to allow county funds to be used for the creation of the
Southwest Washington Fairgrounds. Swofford considered the funding a state issue and a legal dispute was ignited. The
Washington Supreme Court sided with Swofford. ==Personal life and death==