[HUDI-337] Merge on Read incremental pull has in-consistent results

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.5.1
• Component/s: incremental-query
• Labels: pull-request-available
• Assignee: Nishith Agarwal
• Reporter: Nishith Agarwal
• Created: 16/Nov/19 11:02
• Updated: 17/Nov/19 23:15
• Resolved: 17/Nov/19 23:15

Description

Consider the following example :

1.deltacommit
2.inflight
3.rollback <- because rollback was initiated after startCommit

Now, for the logReader, we pass the latestInstant allowed to be getCompletedInstants(COMMIT, DELTACOMMIT, ROLLBACK).
Now, since the latestInstant from the call above is "3", the inflight logblocks will be returned leading to invalid values.

Issue Links

• links to: GitHub Pull Request #996