Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-3272

A lot of repetitions occurred when sending messages using kafkaSink

    XMLWordPrintableJSON

Details

    • Question
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.8.0
    • notrack
    • Sinks+Sources
    • None
    • Hide
      I added a piece of logic to KafkaSink's process() method. The main effect is to get a valid event, get the body from it, make some changes, and then set the event.Then I packaged it and passed it to the server.
      But after going online, kafka received a large number of duplicate messages from the flume.
      I really don't know what it caused, so I would like to ask you why, thank you!
      Show
      I added a piece of logic to KafkaSink's process() method. The main effect is to get a valid event, get the body from it, make some changes, and then set the event.Then I packaged it and passed it to the server. But after going online, kafka received a large number of duplicate messages from the flume. I really don't know what it caused, so I would like to ask you why, thank you!

    Attachments

      Activity

        People

          Unassigned Unassigned
          yukun.liu 刘玉坤
          Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

          Dates

            Created:
            Updated: