Harper, who hit 10 homers in his previous 12 games, was batting with two outs in the third Wednesday night when Adam Warren's first pitch of the at-bat was called a strike by plate umpire Marvin Hudson.
Harper stepped out of the batter's box, leading to an animated back-and-forth with Hudson.
Harper was tossed, bringing Williams out of the dugout. Williams moved Harper aside and began arguing with Hudson, getting kicked out, too. Williams then went over and kicked dirt on home plate - one swipe with each foot.
Michael A. Taylor replaced Harper for that at-bat, striking out, then took over in right field.