In 1803, when he was 26 years old, he married Harriet Suydam (1782–1860), the sister of his brother's wife. Together, they were the parents of: • William Whitney (1816–1862), who married Mary Stuart McVickar (1817–1907) in 1843. The executors of his estate later had a marble chapel built at his burial site. Harriet Suydam Whitney died four months later, in May 1860.
Residence In 1825, Whitney had a townhouse built at Number 7 Bowling Green, at the corner of State Street and Broadway—the current site of the old
Custom House that is now home to the
Heye Indian Museum. The seven houses in the block, which faced across Bowling Green and straight up Broadway, were among the most fashionable in the city when they were built. However, as the city quickly evolved, wealthy residents began to move "uptown" to Washington Square and Fifth Avenue. Stephen Whitney, who was famous for refusing to bend to fashion, was still living at 7 Bowling Green when he died, even though the neighborhood had become somewhat run down and all of his peers had moved away.
Wealth Whitney was among the first multi-millionaires in the city. Many accounts refer to his fortune as second only to that of
John Jacob Astor, who died in 1848 with an estate of $20 million (~$ in ). Whitney's wealth was estimated at his death to be at least $8 million, although some thought it was $10 or even $15 million. Also through his son William, he was a great-grandfather of Mary Stuart Whitney who married Robert Livingston Stevens, son of
Edwin Augustus Stevens. Their son, Robert Livingston Stevens Jr. married Grace Vanderbilt Davis, daughter of
Brig. General Cornelius and
Grace Vanderbilt. ==References==