Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-2799

Kafka Source - Message Offset and Partition add to headers

Agile BoardAttach filesAttach ScreenshotVotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Implemented
    • 1.6.0
    • 1.7.0
    • Sinks+Sources
    • Patch

    Description

      Currently Kafka source only persists the original kafka message's topic into the Flume event headers.

      For downstream interceptors and sinks that may want to have available to them the partition and the offset , we need to add these.

      Also it is noted that the conversion from MessageAndMetaData to FlumeEvent is not configurable unlike other sources such as JMS.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            michael.andre.pearce Michael Andre Pearce
            Votes:
            0 Vote for this issue
            Watchers:
            10 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 24h
              24h
              Remaining:
              Remaining Estimate - 24h
              24h
              Logged:
              Time Spent - Not Specified
              Not Specified

              Slack

                Issue deployment