[HUDI-1910] Supporting Kafka based checkpointing for HoodieDeltaStreamer

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 0.9.0
• Component/s: deltastreamer
• Labels: pull-request-available sev:normal triaged
• Assignee: Vinay
• Reporter: Nishith Agarwal
• Created: 18/May/21 02:10
• Updated: 30/Jul/21 23:05
• Resolved: 30/Jun/21 08:49

Description

HoodieDeltaStreamer currently supports commit metadata based checkpoint. Some users have requested support for Kafka based checkpoints for freshness auditing purposes. This ticket tracks any implementation for that. 

Issue Links

• links to: GitHub Pull Request #3092

Sub-Tasks

• Support Hudi to read from Kafka Consumer Group Offset: Resolved