[HUDI-8436] Move secondary index merge logic to MetadataPartitionType.combineMetadataPayloads

• Type: Sub-task
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Fix Version/s: 1.0.1
• Story Points: 3
• Assignee: Sagar Sumit
• Reporter: Sagar Sumit
• Created: 25/Oct/24 10:49
• Updated: 12/Dec/24 23:20

Description

https://github.com/apache/hudi/pull/12105/files#r1815875535

We need to move this logic inside `HoodieMetadataPayload.combineSecondaryIndexRecord`, and need to override `MetadataPartitionType.combineMetadataPayloads` for secondary index.

While updating secondary index, merging logic should follow same logic as readFromBaseAndMergeWithLogRecords API