Schafer was born on a small farm near
Stanton, North Dakota the second of three children born to Edward and Bertha Schafer. His brother Gordon was born in 1911, his sister Ethelwyn in 1916. Harold spoke only German at home until he went to elementary school. During his school years, the family moved repeatedly. In 1919, the Schafers moved from the farm near Stanton to another small farm near
Hazen, then to
Killdeer in 1920 and to Bismarck in 1922. Harold next spent a considerable period of time with his mother's family near
Rosebud, South Dakota. In 1924, when Schafer was 12 years old, his father left the family and Harold moved back to
Bismarck to live with his mother. He and his mother subsequently moved to
Jamestown, then to
Glen Ullin and finally back to Bismarck in 1927. Schafer graduated from Bismarck High School. During this period in his life, Schafer took his first paid job at the age of eight working in a butcher shop in Killdeer. When his family moved to Bismarck he worked as a newspaper boy, did janitorial work and was employed as a gas station attendant. In Jamestown he candled eggs, sold flowers and worked as a department store clerk. In Glen Ullin he worked on a threshing crew, and by the time he was back in Bismarck and graduating from high school, Schafer did odd jobs at the Dahl clothing store, was an usher at the Capitol Theater, a bellhop at the
Patterson Hotel, and an attendant at the
Standard Oil Service Station. He also delivered milk, shoveled snow and was offered a job as a salesman at Bergeson's clothing store. In 1929, Schafer enrolled at the
North Dakota State Agricultural College (now NDSU) in Fargo. He continued to work at multiple jobs and once again his employment included work as a salesman, this time at the Globe Clothing Company. Schafer left college after one year and hit the road as a traveling salesman. By 1931, at the age of 19, he returned to Bismarck where once again he found work at the Dahl Clothing Store. Schafer was forced to take a job at a clothing store in
Glasgow, Montana, almost immediately after his first wedding but, by January 1, 1936, he was back in Bismarck and working for Vantine's Paint and Glass. He switched to Fargo Glass and Paint in November 1936 and then worked for that company as a traveling salesman for several years. ==Gold Seal Company==