New York is wrongly purging voter rolls to remove the names of supposedly inactive voters, according to a federal lawsuit filed Wednesday on behalf of a government watchdog group.