Ann Fitzhugh Smith was daughter of Colonel William Frisby Fitzhugh, proprietor of "The Hive" at
Chewsville, Maryland, in
Washington County, Maryland, near
Hagerstown. William Fitzhugh, with
Nathaniel Rochester and Charles Carroll, purchased a 100-acre tract at the
Genesee Falls, later to become
Rochester, New York. William D. Fitzhugh descended paternally from William Fitzhugh of
Bedford, England, born in 1570. Henry Fitzhugh, also of Bedford, was born to the eponymous William in 1615. The first Colonel William Fitzhugh, son of Henry, was also born in 1651 at Bedford. The first Colonel William emigrated to
Westmoreland County, Virginia. He married Sarah Tucker (May 1, 1674), and died in 1701. His son, George Fitzhugh, farmed in
Stafford County, Virginia, and was spouse to Mary Mason. The next Colonel William Fitzhugh, also of Stafford County, Virginia, was George's son born on January 11, 1721. He was Ann Fitzhugh Smith's grandfather and died February 11, 1798. He married Mrs. Anne Rousby (1727–1793), née Frisby, of
Cecil County, Maryland, on January 7, 1752. She was born September 15, 1727, and died March 26, 1793. Colonel William Fitzhugh (1761–1839) of the Hive Ann's father, was born in
Calvert County, Maryland. Ann's mother, Ann Hughes (1771–1828), was daughter to iron-mongering entrepreneur Daniel Hughes of
Washington County, Maryland. Ann Hughes married Colonel William at Saint John's Episcopal Church, Hagerstown, on October 18, 1789. The Fitzhughs and the Hughes were communicants at
Saint John's Episcopal Church, Hagerstown, Maryland. The Ascension Window in St. John's north transept was donated in memory of Ann Fitzhugh's mother. Their daughter Ann, and her spouse Gerrit, were relatively secure financially, except immediately after the
Panic of 1837. After that crash, the Smiths moved from the Peterboro mansion to a cottage. Both Ann and her daughter. Elizabeth, clerked in Gerrit Smith's land office to economize. Ann and Gerrit Smith joined the Peterboro Presbyterian Church in 1826. They had seven children, five of whom died young. Ann's surviving children were Elizabeth, mother of
Gerrit Smith Miller, and
Greene (1842–1886). ==Death==