The Cavaliers were viewed as a championship contender in the preseason but are currently in fifth place in the Eastern Conference standings with an 18-14 record and have lost four of their last five games.
"I'm here to build something great in the present and in the future, and that's the reason I'm back," James said, according to ESPN.com. "I got no other reason to have to continue to talk about things that's so outlandish. I'm here. This is where I'll be, and this is where I'm comfortable at."
James sat out his second consecutive game on Wednesday due to knee soreness. The Cavaliers face the Hornets in Charlotte on Friday.