Peters was born at 38 Queen Street in
Salford,
Lancashire, England. James Peters' Jamaican father, George, had been mauled to death in a training cage by lions. His mother, Hannah Gough originally from
Shropshire, was unable to look after him so allowed him to join another circus troupe as a bareback horse rider. He was abandoned by the circus at age 11, having broken his arm, and found himself in Fegan's orphanage in
Southwark, and then Little Wanderers' Home in
Greenwich, where he captained many of their sports teams.
Greenwich Admirals Rugby League Club now celebrate Peters' life with an annual challenge game. Peters trained in printing and carpentry; his trade brought him to
Bristol, where he played as a
fly-half for
Dings Crusaders, Knowle and
Bristol Rugby Club, and represented the Somerset County team between 1900 and 1903. His presence at Bristol was opposed by some on racist grounds: a committee member at Bristol resigned in protest at his selection for the team, whilst a local newspaper described him as a "palid blackamoor", and complained that he was "keeping a white man out of the side". Peters then moved on to
Plymouth in 1902, representing
Plymouth RUFC, and the
Devon county side until 1909. He was the star player in the Devon side which won the
County Championship in 1906, resulting in the press calling for his selection for the national team. ==England international==