Trailing 66-60 with 3:08 to play, Baldwin hit two free throws to pull the Spartans within 66-63, hit a jumper to make it a one-point game, and then scored the winning layup with five seconds left. Baldwin blocked Stephen Croone's attempted 3-pointer on Furman's next possession and time expired.
White scored 14 points in the first half and the score was tied at 39 at halftime.
The Spartans outshot the Paladins 42 percent to 35 percent and made 18 of 23 free throws.
Croone led Furman (7-8, 1-1) with 27 points, including five of 11 on 3-pointers, tying a career best.