He married Elizabeth Williams, whose grandfather
Robert Williams had been a prominent patriot in Pittsylvania County during the American Revolutionary War. She bore two sons, Nathaniel Williams Kerr and
John Kerr, Jr. who also would become a U.S. Congressman.
Bartlett Yancey was his cousin and, and
John H. Kerr would be his grand-nephew. A native of the area, Kerr was licensed as a minister in 1802 and moved to
Halifax County, Virginia in 1805; he later lived in
Pittsylvania County, Virginia as well. ==Death==