Olsen had been listed as questionable on Friday's injury report after missing last Wednesday's practice and then participating on a limited basis later in the week. He leads the Panthers in catches with 61 and is second in yards receiving with 778.
Carolina had already ruled out running back DeAngelo Williams with a hand injury and guard Amini Silatolu with a knee injury. Other Carolina scratches are healthy reserves, including safety Robert Lester, linebacker Horace Miller and offensive tackle David Foucault.
AP NFL website: www.pro32.ap.org and www.twitter.com/AP-NFL