After the end of his baseball career, Taylor returned to Ohio State as assistant basketball coach in 1958, becoming head coach the following year. During his 18 years at Ohio State, the Buckeyes won the 1960 NCAA championship, were runners-up in 1961 and 1962 to Cincinnati (as coached by
Ed Jucker) and claimed a third-place finish in 1968. When Taylor made his third straight Final Four in 1962, he was only the third coach ever to reach
three consecutive Final Fours after
Phil Woolpert and
Harold Olsen. His Final Four appearance in 1968 made him the sixth coach to reach that mark. The last time he coached the Buckeyes to an NCAA tournament appearance was in 1971, where Ohio State upset previously unbeaten
Marquette in the Mideast Regional semifinal round. However,
Western Kentucky beat OSU in the Mideast Regional round to advance to the
Final Four. In his five NCAA tournament appearances, Taylor's teams went 14–4 and also won or shared seven Big Ten titles. In a three-year span (1960–62), his teams won 68 games in the regular season with four losses while going 10–2 in the NCAA Tournament. At one point in Taylor's tenure with the Buckeyes, the team won 32 straight games, and they once had a home winning streak of fifty games. Taylor finished his career with an overall record of 297–158 and was named Coach of the Year by the
USBWA and
UPI in 1961 and 1962. A talented recruiter, Taylor coached six All-Americans as well as Hall of Famers
Jerry Lucas,
John Havlicek and
Bobby Knight. Taylor served as president of the
National Association of Basketball Coaches in 1972 and was a member of the U.S. Olympic Basketball Committee from 1964 to 1972. He also served on the University Division of the NCAA Tournament Selection Committee for a number of years. ==Retirement==