Over 12 innings this season, Gausman recorded a 4.50 ERA with 13 strikeouts and five walks.
His last appearance came against the New York Mets on Wednesday.
Gausman, the No. 4 pick in the 2012 draft, started 20 games last season, posting a 3.57 ERA with 88 strikeouts and 38 walks.
The Orioles, which rank 18th in MLB in bullpen ERA, are in last place in the AL East with a 12-14 record.
Baltimore opens a series against the New York Yankees on Friday.