Patterson returned to the
VFL as coach of
St Kilda from 1978 until Round 2 of 1980. After an extremely uneven 1978 season that nonetheless saw the Saints improve from three wins and two draws to eleven wins and a draw, in 1979 St Kilda collected the wooden spoon for the second time in three years. Former player and trucking millionaire
Lindsay Fox had been brought into the club, as president, in 1979. One of his actions was to facilitate the signing of high-profile
Alex Jesaulenko as an on-field player only. However this placed great pressure on Patterson's position as Jesaulenko had an established record as a captain/coach, having the year previously led Carlton to premiership victory. During the Round 2 match two St Kilda players, in an attempt to win the ball, comically bumped into each other. Fox declared this indicated a lack of discipline that could no longer be tolerated. Patterson was sacked immediately for Jesaulenko. ==Frankston==