After losing 56-14 last week to the Atlanta Falcons, the Bucs have started the season 0-3 under new head coach Lovie Smith.
Martin injured his left knee during Week 1 and did not play the past two games. After rushing for 1,454 yards and 11 touchdowns as a rookie in 2012, he has only played in seven games since the start of last season.
McCoy broke his hand during Week 2 against the Rams. He said he will be cautious about his return to prevent re-injury.
Cummings also reports defensive end Michael Johnson is expected to return from an ankle injury.
The Buccaneers play the Steelers in Pittsburgh at 1 p.m. ET on Sunday.
- Paul Palladino