Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9349

KafkaConnector Exception while fetching from multiple kafka topics

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.4.0
    • Fix Version/s: 1.4.3, 1.5.0
    • Component/s: Connectors / Kafka
    • Labels:
      None

      Description

      ./flink-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java
       
      It seems the List subscribedPartitionStates was being modified when runFetchLoop iterated the List.
      This can happen if, e.g., FlinkKafkaConsumer runs the following code concurrently:
                      kafkaFetcher.addDiscoveredPartitions(discoveredPartitions);
       

       java.util.ConcurrentModificationException
      	at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:966)
      	at java.util.LinkedList$ListItr.next(LinkedList.java:888)
      	at org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.runFetchLoop(Kafka09Fetcher.java:134)
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Sergey Nuyanzin Sergey Nuyanzin
                Reporter:
                vishalsantv Vishal Santoshi
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: