The Confederation of African football ordered the match to be relocated.
Togo had requested that the match be moved.
"We are scared by the situation," the Togo Football Federation (TFF) said.
Sierra Leone, another West African nation affected by the disease, announced earlier this month that it was calling off all matches because of the Ebola outbreak.
The World Health Organization said last week that the death toll for the outbreak now exceeds 1,100, with the disease having claimed the lives of an estimated 377 people in Guinea as of last week.
- Chris Johnson