Ruben Guerrero scored to pull USF (3-9) within three once more, but Brown closed out the half with a 3-pointer and a left-handed floater at the halftime buzzer for a 44-34 lead. The Blazers maintained a double-digit lead through most of the second half.
Lee scored 11 points, Nick Norton added 10 and dished nine assists. UAB shot 52 percent and had 21 assists - its third straight game with 20 or more - on 29 baskets.
Angel Nunez scored 18 points for USF.