Born in Belfast, Spence was the older brother of
Gusty, later to become an even more prominent loyalist. He was the son of William Edward Spence, who was born in
Whitehaven, England but raised in Belfast, and Isabella Hayes. In 1945, Billy Spence was critical of his younger brother's invitation to
Paddy Devlin to play for the Old Lodge soccer team. In keeping with the military tradition of the family, Spence served with the
Royal Navy as a young man. He then worked in the Belfast Corporation's transport department as a
timekeeper. In this role he served as a member of the
Transport and General Workers' Union. He flirted with
socialism and was sometimes critical of the refusal of the
Ulster Unionist Party to run working class candidates in deprived areas. ==Ulster Protestant Action==