[HUDI-1292] [Umbrella] RFC-15 : Metadata Table for File Listing and other table metadata

• Type: Epic
• Status: Closed
• Priority: Blocker
• Resolution: Done
• Affects Version/s: 0.9.0
• Fix Version/s: 0.11.0
• Component/s: spark, writer-core
• Labels: hudi-umbrellas pull-request-available
• Story Points: 0
• Epic Name: Metadata Table for File Listing & Query Planning
• Assignee: Ethan Guo
• Reporter: Vinoth Chandar
• Created: 23/Sep/20 02:32
• Updated: 12/Feb/24 06:24
• Resolved: 05/Jul/22 13:18

Description

This is the umbrella ticket that tracks the overall implementation of RFC-15

Issue Links

• blocks: HUDI-1297 [Umbrella] Spark Datasource Support
• is a parent of: HUDI-1592 Metadata listing fails for non partitoned dataset
• is a parent of: HUDI-2017 Some of the Metadata table metrics are incorrect
• is a parent of: HUDI-1717 Metadata Table reader does not show correct view of the metadata
• is a parent of: HUDI-2013 Fallback to file listing may lead to data loss
• is a parent of: HUDI-2016 Metadata table bootstrap does not work when there are inflight instances
• is a parent of: HUDI-842 RFC-15 : Implementation of File Listing elimination
• is a parent of: HUDI-1256 Follow on code improvements to HFile tables
• is a parent of: HUDI-1312 Hive use of Metadata Table
• links to: GitHub Pull Request #2351
• links to: GitHub Pull Request #3427
• links to: GitHub Pull Request #3824