Jimmy graduated from Colbert County High School in Leighton, Alabama in 1968 and the University of North Alabama in 1973. He was selected to the Birmingham Post Herald All-State Football Team in 1967 and played in the Alabama High School All-Star game that same year. In addition to his success in football, he also played baseball for the Indians. He was a Kawanis Club High School All-Star from 1966-1968 and was chosen to play in the high school All-Star baseball game in 1967. He was offered a baseball contract with the Cincinnati Reds in 1968, but chose to attend UNA where he played football and baseball. He has been a member of the Tennessee Valley Football Association and  the Quad-Cities Basketball Officials Association since 1970.