Two of Ashton's sisters married the
Lupton brothers:
Sir Charles Lupton to Katharine and
Arthur Lupton to Harriet. Lord Ashton's first cousin, Helen Potter (née Leech 1839–1932), was the mother of
Beatrix Potter. Sister Elizabeth Marion Ashton married
James Bryce. Ashton married Eva Margaret James, daughter of John Henry James,
JP for
Hertfordshire, and his wife, Jane Ramsden Ashworth, in 1886. They had four children: two sons and two daughters: • Thomas Henry Ashton (8 October 1887 – 20 September 1897) • Marion Evelyn Ashton (born 1890) married Major Robert Wood. • Margaret Joan Ashton (born 1893) married
Hugh Whistler. •
Thomas Henry Raymond Ashton (2 October 1901 – 21 March 1983) succeeded his father in the barony. ==Death==