[HUDI-8632] Support bootstrap files in file group reader-based compaction

• Type: Sub-task
• Status: In Progress
• Priority: Blocker
• Resolution: Unresolved
• Fix Version/s: 1.0.1
• Labels: pull-request-available
• Assignee: Y Ethan Guo
• Reporter: Y Ethan Guo

Reviewers

sivabalan narayanan

• Created: 02/Dec/24 21:31
• Updated: 6 days ago 19:28

Description

testMetadataBootstrapMORPartitionedInlineCompactionOn fails with file group reader-based compaction (HoodieSparkMergeHandleV2).  Currently if the compaction plan and operations contain bootstrap files, the compaction goes through the old flow using the regular HoodieMergeHandle.  We should support bootstrap files in file group reader-based compaction in HoodieSparkMergeHandleV2.

Issue Links

• is a child of: HUDI-8286 Use filegroup reader for compaction
• links to: GitHub Pull Request #12490