[CRUNCH-611] Simplified Kafka Offset Management in HDFS - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.15.0
Component/s: IO
Labels:
None

Description

With the KafkaSource the responsibility of offset management is the burden of the consumer. With some simple APIs it is actually trivial to support read/storing these offsets in an HDFS directory as checkpoints for the source.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

CRUNCH-611.patch
13/Jul/16 15:20
60 kB
Micah Whitacre

Activity

People

Assignee:: Micah Whitacre

Reporter:: Micah Whitacre

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 12/Jul/16 18:09

Updated:: 26/Feb/17 18:33

Resolved:: 30/Jul/16 20:49