On May 10, 1851, Horden received a letter from them, informing him that the Bishop of
Rupert's Land, had made a request for a schoolmaster at
Moose Factory, territory of the
Hudson's Bay Company, and that he had been appointed to fill the position. They also told him to prepare to leave within a month and indicated that they desired that he marry and take his wife out to assist him in his missionary work. He immediately prepared for his new position. He contacted his fiancée of one year, Elizabeth Baker Oke (1826–1908), a teacher who trained at The
Home and Colonial School Society (Gray’s Inn Road, London), and someone who also had missionary aspirations, and they quickly married (May 28, 1851).{{cite web |url=http://faculty.nipissingu.ca/johnlo/publications/Shaganash-3.pdf On June 8, 1851, the young couple set sail for North America. Horden spent much of his time on the trip by continuing his studies of the Greek
Testament and of the
Cree language. He benefited from the prior experience of several of the crew of the ship with the language and had developed a small vocabulary by the end of the voyage. He also learned to play the accordion. Elizabeth's first pupil was onboard, a woman returning to Hudson's Bay. The ship arrived at
Moose River on August 26 and the passengers were delivered to Moose Factory. The young couple lived at the residence of Chief Factor Robert Miles, affording them some time to acclimate to the daily routines at Moose Factory before moving into the repaired Methodist parsonage just ahead of winter. It was Miles who had persistently urged for a replacement for Barnley at the mission, having lost his two front teeth, he remarked "…it is a labor for me now to read the service." Horden engaged a young
native in conversation, making several mistakes initially. He found that prior missionaries had already created a translation of the
Lord's Prayer and a few biblical texts, and he used the existing transliteration system to help him in his own studies. He continued to go among the natives, writing down new words as he heard them and, after eight months' effort, becoming able to preach to the natives without an interpreter. Horden created his own version of the Lord's Prayer, later translating the
Apostles' Creed, the
Ten Commandments, some prayers from services, a few hymns, and some passages of scripture, all of which he copied and circulated among the natives. He used the opportunity he had at the mission school to teach the adults and children how to read and write, and the fundamentals of
Christianity. Horden also worked to address the spiritual needs of the staff of the Hudson's Bay Company at Moose Factory. They were very grateful and, along with the native parishioners, repaired the church, improved the residence that he and his family used, and built a schoolhouse. ==Mission priest and Cree bible==