[HUDI-7096] Improve Incr Query for partitions touched based on start and end

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.1
• Component/s: reader-core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: sivabalan narayanan
• Created: 15/Nov/23 04:19
• Updated: 22/Nov/23 06:56
• Resolved: 22/Nov/23 06:56

Description

We could improve incr query by directly fetching the partitions based on commit metadata for commits based on start and end. And thus avoiding to poll metadata table or do file system based listing to fetch partitions in FileIndex

Issue Links

• links to: GitHub Pull Request #10098