[HUDI-3176] Add index commit metadata

• Type: Task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Component/s: index, metadata
• Story Points: 0
• Epic Link: Async Metadata Indexing
• Assignee: Sagar Sumit
• Reporter: Sagar Sumit
• Created: 05/Jan/22 11:32
• Updated: 28/Feb/22 09:06
• Resolved: 19/Jan/22 04:14

Description

We need index request metadata at the time of index planning and index commit metadata at the time of index execution, which should tell which metadata partitions are planned/pending to be indexed and not available.

Issue Links

• relates to: HUDI-2488 Support async metadata index creation while regular writers and table services are in progress