Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2799

Kafka Source - Message Offset and Partition add to headers

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Implemented
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.7.0
    • Component/s: Sinks+Sources
    • Labels:
    • Flags:
      Patch

      Description

      Currently Kafka source only persists the original kafka message's topic into the Flume event headers.

      For downstream interceptors and sinks that may want to have available to them the partition and the offset , we need to add these.

      Also it is noted that the conversion from MessageAndMetaData to FlumeEvent is not configurable unlike other sources such as JMS.

        Attachments

        1. FLUME-2799-0.patch
          11 kB
          Michael Andre Pearce

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                michael.andre.pearce Michael Andre Pearce
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified