Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7287

test instability in Kafka010ITCase.testCommitOffsetsToKafka

    Details

      Description

      sporadically, Kafka010ITCase.testCommitOffsetsToKafka seems to be failing, e.g.

      ================================================================================
      Test testCommitOffsetsToKafka(org.apache.flink.streaming.connectors.kafka.Kafka010ITCase) is running.
      --------------------------------------------------------------------------------
      12:29:31,597 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - 
      ===================================
      == Writing sequence of 50 into testCommitOffsetsToKafkaTopic with p=3
      ===================================
      12:29:31,597 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - Writing attempt #1
      12:29:31,598 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl  - Creating topic testCommitOffsetsToKafkaTopic-1
      12:29:31,598 INFO  org.I0Itec.zkclient.ZkEventThread                             - Starting ZkClient event thread.
      12:29:31,599 INFO  org.I0Itec.zkclient.ZkClient                                  - Waiting for keeper state SyncConnected
      12:29:31,601 INFO  org.I0Itec.zkclient.ZkClient                                  - zookeeper state changed (SyncConnected)
      12:29:31,615 INFO  org.I0Itec.zkclient.ZkEventThread                             - Terminate ZkClient event thread.
      12:29:31,719 INFO  org.I0Itec.zkclient.ZkEventThread                             - Starting ZkClient event thread.
      12:29:31,722 INFO  org.I0Itec.zkclient.ZkClient                                  - Waiting for keeper state SyncConnected
      12:29:31,728 INFO  org.I0Itec.zkclient.ZkClient                                  - zookeeper state changed (SyncConnected)
      12:29:31,729 INFO  org.I0Itec.zkclient.ZkEventThread                             - Terminate ZkClient event thread.
      12:29:31,832 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Starting FlinkKafkaProducer (3/3) to produce into default topic testCommitOffsetsToKafkaTopic-1
      12:29:31,840 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Starting FlinkKafkaProducer (2/3) to produce into default topic testCommitOffsetsToKafkaTopic-1
      12:29:31,842 WARN  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Flushing on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing.
      12:29:31,844 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Starting FlinkKafkaProducer (1/3) to produce into default topic testCommitOffsetsToKafkaTopic-1
      12:29:31,844 WARN  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Flushing on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing.
      12:29:31,846 WARN  org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase  - Flushing on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing.
      12:29:31,998 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - Finished writing sequence
      12:29:31,998 INFO  org.apache.flink.streaming.connectors.kafka.KafkaTestBase     - Validating sequence
      12:29:32,123 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
      12:29:32,129 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
      12:29:32,136 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
      12:29:32,139 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 0 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=1}]
      12:29:32,154 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 2 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=0}]
      12:29:32,236 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 1 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=2}]
      12:29:32,496 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
      12:29:32,507 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
      12:29:32,521 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - No restore state for FlinkKafkaConsumer.
      12:29:32,531 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 1 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=2}]
      12:29:32,535 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 2 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=0}]
      12:29:32,628 INFO  org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase  - Consumer subtask 0 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=1}]
      12:29:33,017 ERROR org.apache.flink.streaming.connectors.kafka.Kafka010ITCase    - 
      --------------------------------------------------------------------------------
      Test testCommitOffsetsToKafka(org.apache.flink.streaming.connectors.kafka.Kafka010ITCase) failed with:
      java.lang.RuntimeException: Job failed with an exception
      	at org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runCommitOffsetsToKafka(KafkaConsumerTestBase.java:251)
      	at org.apache.flink.streaming.connectors.kafka.Kafka010ITCase.testCommitOffsetsToKafka(Kafka010ITCase.java:162)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
      	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: org.apache.flink.runtime.client.JobCancellationException: Job was cancelled.
      	at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply$mcV$sp(JobManager.scala:921)
      	at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:873)
      	at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:873)
      	at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
      	at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
      	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40)
      	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
      	at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
      	at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
      	at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
      	at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
      
      

      https://s3.amazonaws.com/archive.travis-ci.org/jobs/258046274/log.txt?X-Amz-Expires=30&X-Amz-Date=20170727T155552Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAJRYRXRSVGNKPKO5A/20170727/us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host&X-Amz-Signature=0b629a0c2b5daedc65c8aa8eb3293bc956f8fd61dc70066a051ed5878b004dbf

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                NicoK Nico Kruber
                Reporter:
                NicoK Nico Kruber
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: