[HUDI-2918] Metadata table virtual keys need to be disabled by default

• Type: Task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.10.0
• Labels: pull-request-available
• Story Points: 2
• Assignee: Manoj Govindassamy
• Reporter: Manoj Govindassamy
• Created: 02/Dec/21 19:59
• Updated: 29/Mar/24 01:25
• Resolved: 29/Mar/24 01:25

Description

Metadata table virtual keys is enabled by default. Recently we found https://issues.apache.org/jira/browse/HUDI-2902 that after compaction, the metdata table records have the meta fields irrespective of the virtual keys flags. This results in the metadata table with base files having records with meta fields and the delta files records with no meta fields. Better to turn off the virtual keys for the metadata table by default, and lets enable the default only after knowing all code paths are covered/tested for the metadata table.

 

Issue Links

• links to: GitHub Pull Request #4196