Kevin Hayes scored just 3:14 into overtime to give the Rangers a 2-1 win over the Penguins and a 3-1 series lead.
Hayes deposited the puck, which pinballed through the crease and under Pittsburgh goalie Marc-Andre Fleury, into the net.
The Penguins headed into Wednesday's match up not having won a playoff game in overtime since 2009. They jumped out to an early 1-0 lead after Patric Hornqvist's tip-in 2:22 into the first period and were able to hang onto the lead until Derick Brassard knotted the game for the Rangers knotted late in the second period.
The Rangers' win puts the Penguins' season on the brink as the series shifts back to Madison Square Garden for Game 5 on Friday at 7:00 p.m. ET.
-- Whitneigh Kinne