[HUDI-4775] Incremental source for MOR fails

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.1
• Component/s: incremental-query
• Labels: pull-request-available
• Assignee: sivabalan narayanan
• Reporter: sivabalan narayanan
• Created: 04/Sep/22 19:40
• Updated: 06/Sep/22 17:31
• Resolved: 06/Sep/22 17:31

Description

While doing an incremental consumption using IncrSource for MOR hudi table, fails. 

 

Code block of interest in IncrSourceHelper.java

  final HoodieTimeline activeCommitTimeline =
        srcMetaClient.getActiveTimeline().getCommitTimeline().filterCompletedInstants(); 

"commitTimeline" may not work for MOR table. we need to fix it for MOR table.

 

Issue Links

• links to: GitHub Pull Request #6587