Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3274

Prefix Kafka connector accumulators with unique id

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 1.0.0
    • Connectors / Kafka
    • None

    Description

      Flink might chain together two data sinks under certain conditions.
      In that case, the metrics accumulators will have a name clash (each task can have an accumulator only once, with chaining multiple sinks are sharing a task).

      Also, when merging accumulators from different tasks for a per-job result, having multiple kafka producers or consumers will lead to wrong results as the merging happens only on a per-name basis.

      With this issue, I'd like to introduce a unique id for consumers and producers when registering accumulators

      Attachments

        Activity

          People

            rmetzger Robert Metzger
            rmetzger Robert Metzger
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: