Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
1.4.0
Description
sporadically, Kafka010ITCase.testCommitOffsetsToKafka seems to be failing, e.g.
================================================================================ Test testCommitOffsetsToKafka(org.apache.flink.streaming.connectors.kafka.Kafka010ITCase) is running. -------------------------------------------------------------------------------- 12:29:31,597 INFO org.apache.flink.streaming.connectors.kafka.KafkaTestBase - =================================== == Writing sequence of 50 into testCommitOffsetsToKafkaTopic with p=3 =================================== 12:29:31,597 INFO org.apache.flink.streaming.connectors.kafka.KafkaTestBase - Writing attempt #1 12:29:31,598 INFO org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl - Creating topic testCommitOffsetsToKafkaTopic-1 12:29:31,598 INFO org.I0Itec.zkclient.ZkEventThread - Starting ZkClient event thread. 12:29:31,599 INFO org.I0Itec.zkclient.ZkClient - Waiting for keeper state SyncConnected 12:29:31,601 INFO org.I0Itec.zkclient.ZkClient - zookeeper state changed (SyncConnected) 12:29:31,615 INFO org.I0Itec.zkclient.ZkEventThread - Terminate ZkClient event thread. 12:29:31,719 INFO org.I0Itec.zkclient.ZkEventThread - Starting ZkClient event thread. 12:29:31,722 INFO org.I0Itec.zkclient.ZkClient - Waiting for keeper state SyncConnected 12:29:31,728 INFO org.I0Itec.zkclient.ZkClient - zookeeper state changed (SyncConnected) 12:29:31,729 INFO org.I0Itec.zkclient.ZkEventThread - Terminate ZkClient event thread. 12:29:31,832 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Starting FlinkKafkaProducer (3/3) to produce into default topic testCommitOffsetsToKafkaTopic-1 12:29:31,840 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Starting FlinkKafkaProducer (2/3) to produce into default topic testCommitOffsetsToKafkaTopic-1 12:29:31,842 WARN org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Flushing on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing. 12:29:31,844 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Starting FlinkKafkaProducer (1/3) to produce into default topic testCommitOffsetsToKafkaTopic-1 12:29:31,844 WARN org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Flushing on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing. 12:29:31,846 WARN org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Flushing on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing. 12:29:31,998 INFO org.apache.flink.streaming.connectors.kafka.KafkaTestBase - Finished writing sequence 12:29:31,998 INFO org.apache.flink.streaming.connectors.kafka.KafkaTestBase - Validating sequence 12:29:32,123 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer. 12:29:32,129 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer. 12:29:32,136 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer. 12:29:32,139 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 0 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=1}] 12:29:32,154 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 2 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=0}] 12:29:32,236 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 1 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=2}] 12:29:32,496 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer. 12:29:32,507 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer. 12:29:32,521 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No restore state for FlinkKafkaConsumer. 12:29:32,531 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 1 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=2}] 12:29:32,535 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 2 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=0}] 12:29:32,628 INFO org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 0 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=1}] 12:29:33,017 ERROR org.apache.flink.streaming.connectors.kafka.Kafka010ITCase - -------------------------------------------------------------------------------- Test testCommitOffsetsToKafka(org.apache.flink.streaming.connectors.kafka.Kafka010ITCase) failed with: java.lang.RuntimeException: Job failed with an exception at org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runCommitOffsetsToKafka(KafkaConsumerTestBase.java:251) at org.apache.flink.streaming.connectors.kafka.Kafka010ITCase.testCommitOffsetsToKafka(Kafka010ITCase.java:162) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.flink.runtime.client.JobCancellationException: Job was cancelled. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply$mcV$sp(JobManager.scala:921) at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:873) at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:873) at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Attachments
Issue Links
- links to
