Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2799

Kafka Source - Message Offset and Partition add to headers

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Implemented
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.7.0
    • Component/s: Sinks+Sources
    • Labels:
    • Flags:
      Patch

      Description

      Currently Kafka source only persists the original kafka message's topic into the Flume event headers.

      For downstream interceptors and sinks that may want to have available to them the partition and the offset , we need to add these.

      Also it is noted that the conversion from MessageAndMetaData to FlumeEvent is not configurable unlike other sources such as JMS.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              michael.andre.pearce Michael Andre Pearce

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified

                  Issue deployment