Xu Jishen was a member of the Chinese Workers' and Peasants' Red Army. He was born in Lu'an, Anhui Province. In 1919, he participated in the May Fourth Movement. In 1920, he went to Anqing. In April 1921, he joined the Communist Youth League of China. In 1923, Xu left Anhui for Shanghai, enrolling in Shanghai University. In 1924, Xu entered the Whampoa Military Academy and joined the Chinese Communist Party. He quickly rose through the ranks from platoon commander to deputy company commander to company commander, ultimately rising to the rank of major. After the Canton Coup, he was made a battalion commander under Ye Ting. During his participation in the Northern Expedition, he was wounded due to the actions of Xia Douyin.