Granger attended
Booker T. Washington High School. He accepted a football scholarship from
Southern University. As a sophomore, he became a starter as a two-way lineman midway through the season. As a senior, he contributed to the team winning the 1960 Black College National Championship. In track, he competed in the
shot put and
discus throw. In 2010, he was inducted into the
Southwestern Athletic Conference Hall of Fame. In 2011, he was inducted into the Southern University Sports Hall of Fame. ==Professional career==