The Blue Hose (2-1) trailed 7-3 for most of the game, but stole momentum when DaRon Dickey forced and recovered a fumble at Furman's 43.
Presbyterian rushed seven straight times to get into the red zone, but a holding penalty moved the ball back to the Furman 17. Facing a third-and-goal, McMath and Hurley connected to give the Blue Hose their first lead.
The kickoff was delayed nearly two hours due to a lightning storm in the area. It was Presbyterian's first win against the Paladins since a 17-10 victory in 1979.