In 1692 Le Neve was staying at
Mannington Hall in
Itteringham, after which he resided at Witchingham Hall. In 1684 Le Neve married Anne Gawdy (1656–1696), who was from a further Norfolk
gentry family at
West Harling, typically of lawyers and MPs. Anne Gawdy was granddaughter to Sir
William Gawdy (1612–1669), who was an MP in the
Cavalier Parliament, and who had bought his
baronetcy in 1663. Anne died in 1696 after producing two boys, one of whom died in 1689 in infancy, and three girls. Le Neve was a good friend to Bassingbourne, Anne's brother, until his death from
smallpox. He renovated and replanted gardens at Witchingham Hall, with plants, particularly fruit, he bought from local contacts, or in London and transported through the port of
Great Yarmouth from the
Thames. Le Neve became a popular and social focus for young
Tory squires, the sons of
Civil War cavaliers, with Witchingham Hall becoming a centre for convivial hospitality, and animosity towards the
Whigs in power and the
court. The pastimes he and his friends favoured were hunting with
beagles, shooting, fishing, and horse racing at
Newmarket. Through these he became close friends with John (Jack) Millecent, a
rakish squire from
Linton, Cambridgeshire, whose family also shared mutual animosity with their local Whigs. By 1694 Millecent had persuaded Le Neve to breed and keep his own beagle pack, sold to him by Millecent who later stated it was "the finest pack of Beagles in England". The growing reputation of Le Neve's pack in 1697 prompted Sir
Horatio Pettus Bt. to beg a hound off him, one of a number sold to members of the Norfolk gentry. In 1707, after hunting hare and fox in Norfolk, Essex and Surrey, Le Neve sold his pack, only to buy another soon after. After the death of Le Neve's wife Anne, Millecent promoted a match with Jane Knyvet (b.1670), referred to as one of the "
Darsham Ladies" of
Suffolk, and the fourth daughter to Sir John Knyvet of
Ashwellthorpe; Le Neve married her in 1698. ==Election and animosity==