[HUDI-3462] List of fixes to Metadata table after 0.10.1

• Type: Task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: metadata
• Assignee: Ethan Guo
• Reporter: sivabalan narayanan
• Created: 21/Feb/22 14:16
• Updated: 07/Mar/23 01:21
• Resolved: 07/Mar/23 01:20

Issue Links

• is related to: HUDI-2925 Cleaner may attempt to delete the same file twice when metadata table is enabled
• is related to: HUDI-3322 Rollback Plan for Delta Commits constructed incorrectly
• is related to: HUDI-3343 Metadata Table includes Uncommitted Log Files during Bootstrap
• is related to: HUDI-3365 Make sure Metadata Records always bear full file-size
• is related to: HUDI-3370 The files recorded in the commit do not match the actual ones for MOR Compaction
• is related to: HUDI-3394 Fail to release in-process lock due to IllegalMonitorStateException
• is related to: HUDI-3398 Schema validation fails for metadata table base file
• is related to: HUDI-3494 MOR compaction and archive settings may prevent metadata table compaction
• is related to: HUDI-3495 Reading keys in parallel from HoodieMetadataMergedLogRecordReader may lead to empty results even if key exists
• is related to: HUDI-3544 Reading from Metadata table fails w/ NPE
• is related to: HUDI-3604 Missing to apply rollback commits to Metadata table if rollback failed mid-way
• is related to: HUDI-3624 Re-attempt of failed cleaning from DT to MDT fails
• is related to: HUDI-3720 Rollback reattempt fails if the commit to roll back is not present
• is related to: HUDI-2763 Metadata table records key deduplication
• is related to: HUDI-3435 Do not throw exception when instant to rollback does not exist in metadata table active timeline
• is related to: HUDI-1180 Upgrade HBase to 2.x
• is related to: HUDI-3432 Test restore scenarios with MT table
• is related to: HUDI-3556 re-use rollback instant for compaction and clustering
• is related to: HUDI-3638 Task not serializable due to ZookeeperBasedLockProvider in clean action
• is related to: HUDI-3697 Fix partition fetching in metadata table for non-partitioned table
• is related to: HUDI-3072 AutoCommit misses to detect write conflicts during concurrent transactions