The house was largely built with stone taken from the ruins of the mediaeval
Farleigh Castle. A Trowbridge clothier,
Joseph Houlton, bought the Farleigh Hungerford estate in 1702, and his son, Joseph Houlton the Younger, lived at Church Farm on the estate. He completely rebuilt and turned an old gabled house into Farleigh House, a modest gentleman's residence complete with a deer park. In 1806, Colonel John Houlton inherited the estate. He enlarged and altered the house in the fashionable
Gothic Revival style, spending £40,000 - several million in today's values — on extensions to the main house, a chapel, hot houses, conservatories, stables and six lodges. Most of the present house dates from that period. One of the lodges was called the Castle Lodge and was known as the Bath Lodge Castle Hotel until its closure in June 2022. The Houlton family remained at Farleigh Hungerford until 1899, when Sir Edward Houlton died with no male heir. ==Later owners==