[HUDI-4762] Hive sync update schema removes columns

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Won't Do
• Fix Version/s: 0.12.1
• Component/s: meta-sync
• Labels: pull-request-available
• Story Points: 1
• Assignee: nicolas paris
• Reporter: nicolas paris

Reviewers

Shiyan Xu

• Created: 01/Sep/22 07:58
• Updated: 18/Sep/22 03:47
• Resolved: 18/Sep/22 03:47

Description

Currently when move a hudi table from schema1 to schema2 and then insert data with the old schema1, then schema 2 is kept for the whole table.

This is not consistent with hive metastore which get its schema updated to the old schema1.

Avoid update metastore schema if only missing column in input

Issue Links

• links to: GitHub Pull Request #6537