A man was charged early Wednesday with hitting a uniformed U.S. Secret Service agent who was trying to break up a fight along the White House fence, according to authorities.