Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2868

Kafka Channel partition topic by key

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.6.0
    • 1.7.0
    • Channel
    • None

    Description

      Add the ability to partition a Kafka channel topic by key. Users can currently partition topics by key using a file/memory channel with a Kafka sink. Although this approach adds unnecessary latency and the Kafka sink drops Flume event headers, which can be undesirable.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue FLUME-2823 Flume-Kafka-Channel with new APIs

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLUME-2999 Kafka channel and sink should enable statically assigned partition per event via header

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              jrkinley James Kinley
              Votes:
              3 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: