[HUDI-3410] Revisit Record-reading Abstractions

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Story Points: 8
• Epic Link: RFC-46: Engine Native Record Payloads
• Assignee: Frank Wong
• Reporter: Alexey Kudinkin
• Created: 10/Feb/22 21:05
• Updated: 05/Oct/22 14:52
• Resolved: 05/Oct/22 14:52

Description

Currently, while the logic of combining the all Delta Log files (into a set of delta-records) is commonly unified across all query engines. Actual merging it with the base-files is not. 

We need to revisit that to and make sure: 

• Record merging logic is shared across all Query engines
• There's no duplication of merging logic (currently merging log-files and base-files are completely isolated)