[HIVE-16813] Incremental REPL LOAD should load the events in the same sequence as it is dumped.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 3.0.0
• Component/s: Hive, repl
• Labels: DR replication
• Assignee: Sankar Hariappan
• Reporter: Sankar Hariappan
• Created: 02/Jun/17 12:02
• Updated: 23/May/18 00:00
• Resolved: 09/Jun/17 06:24

Description

Currently, incremental REPL DUMP use $dumpdir/<eventID> to dump the metadata and data files corresponding to the event. The event is dumped in the same sequence in which it was generated.

Now, REPL LOAD, lists the directories inside $dumpdir using listStatus and sort it using compareTo algorithm of FileStatus class which doesn't check the length before sorting it alphabetically.
Due to this, the event-100 is processed before event-99 and hence making the replica database non-sync with source.

Need to use a customized compareTo algorithm to sort the FileStatus.

Issue Links

• links to: GitHub Pull Request #192