Kent scored 10 in the first half and Dalembert had 12 in the second, including 6-of-6 shooting from the free-throw line in the final five minutes.
James Madison led by just four points at halftime, but opened up the second half by going on a 14-2 run for a 42-26 lead.
Towson trailed by 14 points with eight minutes left, but clawed back to within 50-46 with 5:08 left after a 10-0 run. Hawkins scored eight points during the spurt, including two 3-pointers. Dalembert ended the run with two free throws to spark a 6-0 run for another double-digit lead.
Andre Nation had 12 points for James Madison (8-6).