Musser married his first wife, Rose S. Borquist in the
Logan Temple in June 1892, and his second wife, Mary C. Hill, in March 1902. But upon marrying his third wife, Ellis R. Shipp Jr., in July 1907, he caught the attention of the
Salt Lake Tribune, which announced the marriage on its front page. His support of continued plural marriages, in violation of the
first and
second Manifestos of the LDS Church, led him to be called before the
Quorum of Twelve Apostles of the church in July 1909, but this did not lead to any
disciplinary action against him. According to Musser, in 1915 he was given authority to perform plural marriages by "an apostle." He was excommunicated from the LDS Church by the high council of the
Salt Lake City-based Granite Stake on March 21, 1921 for attempting to take Marion Bringhurst as his fourth wife. In May 1932, Musser married again, this time Lucy O. Kmetzsch, and on the May 14, 1929, he was ordained an apostle in the
Council of Friends by
Lorin Calvin Woolley, the then-leader of the Mormon fundamentalist movement. In the 1930s and 1940s, Musser was responsible for editing the Mormon fundamentalist publication
Truth Magazine. His promotion and practice of plural marriage led to his incarceration by the U.S. federal government between May and December 1945. ==Controversy==