The knuckleballer struck out two and walked four in his final spring training start before Monday's opener at Tampa Bay.
Kelly Johnson had a two-run single in the first. Dean Anna hit an RBI double and Carlos Beltran drove in a pair with a double during a four-run second that put New York up 6-0.
Blue Jays slugger Edwin Encarnacion got hit on the right lower arm by a pitch in the fifth and left the game. General manager Alex Anthopoulos said the first baseman has a bruise, but is fine.
Derek Jeter walked, singled and lined out against Dickey. The Yankees captain was limited to 17 games last season after breaking his left ankle in the 2012 playoffs.
Jeter appears to be breaking out of his offensive funk. He singled in his final at-bat Tuesday, and is 7 for 49 (.143) overall.
''We talked about it,'' Yankees manager Joe Girardi said. ''He hasn't played really in a year and a half. Timing is an issue, and it's getting better every day. He'll have tomorrow off and then play the last two games.''
Dickey was happy with his outing, despite the numbers.
''Today was not a day about results,'' Dickey said. ''What was paramount for me was to exercise my arm in a way where I felt good. I was able to use a large range of velocities and I mixed in pitches that I would never throw during the regular season. They put in their heads it's another weapon that I might use on them later. So, I did exactly what I wanted to do.''
Blue Jays: Manager John Gibbons announced that Drew Hutchison and Dustin McGowan have made the starting rotation.
Hutchison will start in Tuesday's game against the Rays. McGowan, who has battled shoulder problems since 2008, won the fifth starter spot and will pitch in the April 4th home opener with the Yankees.
Yankees: Reliever Chris Leroux allowed two runs, including Brett Lawrie's second-inning solo homer, and five hits in three innings. He was hit in the leg by two infield singles in the third, but remained in the game.
The Yankees will start lining up their rotation for the regular season Thursday when opening day starter CC Sabathia will pitch. No. 2 Hiroki Kuroda and No. 4 Masahiro Tanaka are scheduled to throw Friday, with No. 3 Ivan Nova taking the mound Saturday. Fifth starter Michael Pineda will start a minor league intrasquad game Sunday.
Blue Jays: Shortstop Jose Reyes, who missed his fourth game due to left hamstring tightness, took on-field batting practice.
''We expect him to be ready for opening day,'' Anthopoulos said. ''He could DH Friday. We're going day to day with him and see how he feels.''
Yankees: Jacoby Ellsbury, out 1 1/2 weeks because of right calf tightness, played five innings in center fielder during his second minor league game. He is expected to be ready for opening day.
Designated hitter Alfonso Soriano played despite minor tightness in his right shoulder.
Blue Jays: Josh Thole beat out Erik Kratz for the backup catcher spot and will catch Dickey opening day.
''I'm thrilled,'' Thole said. It's a big honor.''
Kratz was sent to the minor league camp. Outfielder Matt Tuiasosopo, claimed off waivers from Arizona last Friday, has been told that he will not make the opening day roster.