Colgate will meet fifth-seeded James Madison (9-2) Dec. 5.
Holland carried 23 times for 95 yards and put the Raiders (8-4) on the board early with a 6-yard TD run five-and-a-half minutes into the game. He added another, this time from the 1, in the second quarter for a 12-3 lead. Kicker Jonah Bowman's first PAT kick slid to the right, ending a 34-for-34 streak. His second was blocked.
Holland's first TD was set up after Chris Morgan recovered a New Hampshire fumble - the first of three turnovers - on the Wildcats' (7-5) opening drive. Holland scored twice after halftime, his fourth touchdown giving Colgate a 27-6 lead.