Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3327

Add method to convrt headers of flume event and ones of kafka record transparently.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.9.0
    • Fix Version/s: None
    • Labels:
      None

      Description

      The only way of delivering headers in flume event to kafka now is serializing event as Avro format of Flume and set it body of kafka.
      In kafka 0.11.0.0, record header is released as new feature.
      If using headers of flume and one of kafka transparently, we do not need to serialize event.
      We add `useKafkaHeader` option to select using record headers of kafka or not.
      By default, the useKafkaHeader option is false because of considering compatibility.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                Takafumi Saito Takafumi Saito
              • Votes:
                1 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m