Brown opened with a 3-pointer and Alabama State led 12-7, then used a 9-2 run to pull away. Derrick Spear hit back-to-back 3-pointers for Fort Valley State, but the Wildcats trailed 41-30 at halftime.
Both Brown and Wendell Lewis scored eight points in the half and the Hornets outshot the Wildcats 51.7 percent to 39.3 percent.
The teams traded baskets in the second half and the Hornets stayed ahead. Brown hit consecutive 3s for a 52-34 Alabama State lead, then Lewis mad a layup for a 73-62 lead with 2:34 left.
Spear led the Wildcats (0-8) with 18, Ralph Wilson had 15 and Tyrone Brinson 12.