Doe was born to Joseph and Mary Bodwell Ricker Doe in
Derry, New Hampshire, on April 11, 1830. He spent his boyhood in the Salmon Falls section of
Somersworth, New Hampshire. Doe began his education at
Berwick Academy in Maine, and in 1844 Doe entered
Phillips Exeter Academy. In 1845, Doe's father withdrew him from Exeter and enrolled him in
Phillips Academy at Andover, which was less expensive. In autumn of 1845, Doe entered
Harvard College where he stayed for only a year, possibly having been expelled for an incident in which he threw a tree stump through the dormitory window of an upperclassman who had tormented him in a
hazing ritual. After leaving Harvard, Doe entered
Dartmouth College, from which he graduated in 1849, having been elected to
Phi Beta Kappa. Doe was bitter about the education he received at Dartmouth, calling it a "barbaric classical course" of study. Upon graduation from Dartmouth, Doe began studying for the bar in the office of Dover attorney Daniel Miltmore Christie, one of the most successful New Hampshire attorneys in training students. After three years of study with Christie, Doe enrolled in
Harvard Law School at a time when the school's quality was at its "low ebb". In 2003, descendants of Doe donated to the library of the
Woodman Institute Museum a 78-page diary covering eight months in Doe's life, between July 1852 and February 1853. According to Jay Surdukowski, Doe's early diary "reveals a hopeful youth struggling to come into his own in a time." In a long article about the journal, Surdukowski writes: Doe's early musings on his chosen career path are uncanny in their modesty. Considering the prominence Doe will achieve in nineteenth century jurisprudence and the shadow he still casts today, 116 years after his death, one is struck by how little Doe actually dwells on the law in the diary. Most of the ink is spilled on other pursuits. His notes on court sessions tend to be perfunctory – records of verdicts, poor jury charges, satchels of work brought back by his mentor Mr. Christie. Perhaps this is why Doe grew up to be the judge and humane personage he would become — his training was spent becoming a well-rounded person in addition to a well-rounded lawyer. ==Personal life==