Richardson married author Anne Roth (now
Anne Roiphe) in 1957, and they had a daughter
Emily Carter. The couple later divorced. Richardson's second wife was Judith Heidler (later Judith Silvia); they also divorced. She became executive director of the Newport Art Association and Museum and later a consultant to Green Collections in Yokohama, Japan. Richardson then married
Susan E. Morse, an
Academy Award-nominated feature film editor best known for her work with
Woody Allen. and, in 2012, for her editing of the popular FX Network show, "Louie," written and directed by and starring Louis C.K., for which Morse was nominated for an Emmy. Richardson and Morse had a son named Dwight, and the marriage lasted until Richardson died in Manhattan in July 2012. == References ==