[FLINK-18020] SQLClientKafkaITCase.testKafka is flaky

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Duplicate
• Affects Version/s: 1.11.0, 1.12.0
• Component/s: Connectors / Kafka, Table SQL / Client, Tests
• Assignee: Aljoscha Krettek
• Reporter: Dawid Wysakowicz
• Created: 29/May/20 06:19
• Updated: 15/Jun/20 09:03
• Resolved: 15/Jun/20 09:03

Description

[ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 151.386 s <<< FAILURE! - in org.apache.flink.tests.util.kafka.SQLClientKafkaITCase
[ERROR] testKafka[1: kafka-version:0.11 kafka-sql-version:.*kafka-0.11.jar](org.apache.flink.tests.util.kafka.SQLClientKafkaITCase)  Time elapsed: 49.811 s  <<< FAILURE!
java.lang.AssertionError: 

Expected: ["2018-03-12 08:00:00.000,Alice,This was a warning.,2,Success constant folding.", "2018-03-12 09:00:00.000,Bob,This was another warning.,1,Success constant folding.", "2018-03-12 09:00:00.000,Steve,This was another info.,2,Success constant folding.", "2018-03-12 09:00:00.000,Alice,This was a info.,1,Success constant folding."] in any order
     but: Not matched: "2018-03-12 08:00:00.000,Alice,This was a warning.,6,Success constant folding."
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
	at org.junit.Assert.assertThat(Assert.java:956)
	at org.junit.Assert.assertThat(Assert.java:923)
	at org.apache.flink.tests.util.kafka.SQLClientKafkaITCase.checkCsvResultFile(SQLClientKafkaITCase.java:241)
	at org.apache.flink.tests.util.kafka.SQLClientKafkaITCase.testKafka(SQLClientKafkaITCase.java:172)

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=2323&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=1e2bbe5b-4657-50be-1f07-d84bfce5b1f5