[FLINK-4905] Kafka test instability IllegalStateException: Client is not started

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: Connectors / Kafka
• Labels: test-stability
• Assignee: Andrew Efimov
• Reporter: Robert Metzger
• Created: 25/Oct/16 09:52
• Updated: 02/Oct/19 17:43
• Resolved: 25/Jan/17 13:34

Description

The following travis build (https://s3.amazonaws.com/archive.travis-ci.org/jobs/170365439/log.txt) failed because of this error

08:17:11,239 INFO  org.apache.flink.runtime.jobmanager.JobManager                - Status of job 33ebdc0e7c91be186d80658ce3d17069 (Read some records to commit offsets to Kafka) changed to FAILING.
java.lang.RuntimeException: Error while confirming checkpoint
	at org.apache.flink.runtime.taskmanager.Task$4.run(Task.java:1040)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: Client is not started
	at org.apache.flink.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:173)
	at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
	at org.apache.curator.utils.EnsurePath$InitialHelper$1.call(EnsurePath.java:148)
	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
	at org.apache.curator.utils.EnsurePath$InitialHelper.ensure(EnsurePath.java:141)
	at org.apache.curator.utils.EnsurePath.ensure(EnsurePath.java:99)
	at org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler.setOffsetInZooKeeper(ZookeeperOffsetHandler.java:133)
	at org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler.prepareAndCommitOffsets(ZookeeperOffsetHandler.java:93)
	at org.apache.flink.streaming.connectors.kafka.internals.Kafka08Fetcher.commitInternalOffsetsToKafka(Kafka08Fetcher.java:341)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.notifyCheckpointComplete(FlinkKafkaConsumerBase.java:421)
	at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.notifyOfCompletedCheckpoint(AbstractUdfStreamOperator.java:229)
	at org.apache.flink.streaming.runtime.tasks.StreamTask.notifyCheckpointComplete(StreamTask.java:571)
	at org.apache.flink.runtime.taskmanager.Task$4.run(Task.java:1035)
	... 5 more
08:17:11,241 INFO  org.apache.flink.runtime.taskmanager.Task                     - Attempting to cancel task Source: Custom Source -> Map -> Map -> Sink: Unnamed (1/3)

Issue Links

• links to: GitHub Pull Request #3035