Kafka
  1. Kafka
  2. KAFKA-1000

Inbuilt consumer offset management feature for kakfa

    Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.8.1
    • Fix Version/s: None
    • Component/s: consumer
    • Labels:

      Description

      Kafka currently stores offsets in zookeeper. This is a problem for several reasons. First it means the consumer must embed the zookeeper client which is not available in all languages. Secondly offset commits are actually quite frequent and Zookeeper does not scale this kind of high-write load.

      This Jira is for tracking the phase #2 of Offset Management [0]. Joel and I have been working on this. [1] is the overall design of the feature.

      [0] : https://cwiki.apache.org/confluence/display/KAFKA/Offset+Management
      [1] : https://cwiki.apache.org/confluence/display/KAFKA/Inbuilt+Consumer+Offset+Management

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Tejas Patil
            Reporter:
            Tejas Patil
          • Votes:
            2 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:

              Development