Freedman was born in
New York City on July 2, 1924. His father,
David Freedman, was a
comedy writer for
Eddie Cantor. Cantor moved to Beverly Hills. In 1936, after David died, Beatrice Freedman, Toby's mother, moved Toby and his three siblings,
Ben,
Noel, and Laurie, to Beverly Hills. Freedman graduated from
Beverly Hills High School at age 16 in 1940, and was an All-Conference football guard. He met football player
Tom Fears in high school, and they became lifelong friends. Freedman received a football scholarship to the
University of California, Berkeley. After three years, he transferred to
Stanford University, receiving a B.A. in biology in 1945, and an M.D. degree from
Stanford Medical School in 1948 along with longtime close friend
Robert Kerlan. He completed his residency in 1951 in
Internal Medicine at the USC Medical Center with Bob Kerlan, under the supervision of Dr. Max Gaspar. Freedman then entered the
U.S. Air Force for five years. ==Space medicine==