The Rays made the moves before Tuesday night's game at Yankee Stadium against New York.
Beliveau was recalled from Triple-A Durham for his third tour with Tampa Bay this season. He retired all six batters he faced in the majors.
Beliveau is making his seventh stint with the Rays in the past two seasons. He has a 1.10 ERA and 10 saves at Durham this year.