[HUDI-3941] Add extrametadata and commitActiontype to write callback

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Story Points: 1
• Epic Link: Improve source ingestion support in DeltaStreamer
• Assignee: sivabalan narayanan
• Reporter: Rajesh Mahindra
• Created: 21/Apr/22 16:25
• Updated: 20/Aug/22 23:32

Description

It would be good to add 2 more fields to the write commit callback. HoodieDeltastreamer uses extraMetadata to store the checkpoints, and its useful to get this info from the callback to get the checkpoints after a commit is written.

public HoodieWriteCommitCallbackMessage(String commitTime,                                          String tableName,                                        
String basePath,                                          List<HoodieWriteStat> hoodieWriteStat,                                          Option<String> commitActionType,                                          Option<Map<String, String>> extraMetadata)