[GOBBLIN-873] Kafka Source should support lookback based on offset window

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0
• Fix Version/s: 0.15.0
• Component/s: gobblin-kafka
• Assignee: Shirshanka Das
• Reporter: Shirshanka Das
• Created: 07/Sep/19 22:08
• Updated: 09/Sep/19 05:57
• Resolved: 09/Sep/19 05:56

Description

Kafka Source currently only supports reset to latest or earliest if the current state is lost or on starting from clean slate. 

This issue proposes to add an additional configuration option to rewind the offset by a specific amount from the current latest for the topic-partition. 

Issue Links

• links to: GitHub Pull Request #2721