Swafford was named an All-State wide receiver after he racked up 1,656 all-purpose yards with 18 touchdowns and three interceptions for Dresden High School. He played in the Western Tennessee All-Star Game and in the TN/Kentucky Border Bowl All-Star Game. His uncle played at Auburn.