[HUDI-1319] Make Async Operations (Clean, Compaction, Replace) work with metadata table

• Type: Task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Labels: pull-request-available
• Epic Link: Metadata Table for File Listing & Query Planning
• Assignee: Vinoth Chandar
• Reporter: Prashant Wason
• Created: 07/Oct/20 23:48
• Updated: 04/Jan/22 00:09
• Resolved: 21/Dec/20 18:16

Description

Two cases:
1. Async process / pipeline (Handle out-of-process Clean and Compaction)
2. AsyncClean service

NOTE: We need to decide where to log update for async operations. If we do it at Async operation completion then we may end up in multi writer scenario.

Issue Links

• links to: GitHub Pull Request #2332