Neither player made the trip to Florida.
Walden is out with an injured foot. Toler hurt his knee in last weekend's loss at Pittsburgh.
Indianapolis (6-6) had already said four other players would not play.
Quarterback Andrew Luck will miss his fourth straight game with a lacerated kidney and a partially torn abdominal muscle.
Left tackle Anthony Castonzo (right knee), inside linebacker Jerrell Freeman (hamstring and ribs) were ruled out Friday. Team officials also decided to hold outside linebacker Daniel Adongo out after police showed up at his suburban Indianapolis house Thursday morning to check on the welfare of a woman inside the home.
AP NFL website: www.pro32.ap.org and www.twitter.com/AP-NFL