Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3394

A Kafka Channel defined as parseAsFlumeEvent=false cannot be correctly used by a Flume sink

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.9.0
    • 1.9.0
    • None
    • None
    • My configuration was wrong, so sorry for that
    • Important

    Description

      When a kafka channel is configured as parseAsFlumeEvent=false, it still parse the events as Avro so that the data will fail to be read correctly from kafka.

      The raw data like below.

      The flume config see below.

      And the data from Kafka topic see below.

      Attachments

        1. image-2021-11-19-22-07-51-535.png
          106 kB
          Haibo Wu
        2. image-2021-11-19-22-12-44-081.png
          73 kB
          Haibo Wu
        3. image-2021-11-19-22-23-46-390.png
          279 kB
          Haibo Wu

        Activity

          People

            Unassigned Unassigned
            Doll Love Haibo Wu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: