Due to the sensitive nature of Vaughn's employment, the US Military Administration declined to allow Vaughn to marry under civil law at the
US Embassy in Tokyo. Vaughn and Vivienne Wilson were married under religious ceremony in Yokohama, Japan on 8 May 1948. The
Department of State declined Vaughn's request to allow his wife to immigrate to the United States, due to the absence of a licit civil license. During this time, Japan was under US Law as
Occupied Japan. In addition, Japan had traditionally ignored the marriages of foreigners. As foreigners had no licit
koseki, or Japanese family record, there was no method for registration of foreigner marriages within Japan. As Vaughn was a civilian employee of the United States, his marriage did not come under the terms of permissible
immigration stipulated for US Military Service Personnel who married foreign women (see
War-bride). Due to the absence of recognized civil marriage, James and Vivienne allegedly suffered harassment by US and Japanese authorities. Upon learning that his wife was pregnant, Vaughn returned to the United States to seek permission for immigration of his pregnant wife. He received assistance from
Patrick McCarran, senator from Nevada, who sponsored private legislation permitting the immigration of Vivienne Joy Wilson to the United States for the purpose of legitimizing their marriage; and recognizing his daughter, Mary Ann Vaughn, who had been born in Yokohama during the interim, as his natural-born daughter. Private legislation was passed by the United States Congress and signed into law on 5 August 1950.
(81st Congress 2nd Session, v.64 part 2, Chapter 596, Private Law 722, For the relief of Vivienne Joy Wilson and minor daughter Mary Ann Vaughn) However, Vivienne had been weakened by the privations of World War II, and contracted
tuberculosis during James Vaughn's absence, during which Mary Ann was cared for by a nanny, Fumi. She died on 5 August 1950, the very day of passage of private legislation permitting her to immigrate to the United States. == Early life ==