A 57-year-old Georgia man was arrested in New York for a string of "violent rapes" he allegedly committed during the 1990s.