Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2054 Fix Kafka transient unit test failures
  3. KAFKA-3874

Transient test failure: org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion

Details

    Description

      The failure I am recording happened in Jenkins, but I had a similar failure locally (and two other integration tests failed in that run).

      Expected: <[KeyValue(europe, 13), KeyValue(americas, 4), KeyValue(asia, 25), KeyValue(americas, 23), KeyValue(europe, 69), KeyValue(americas, 101), KeyValue(europe, 109), KeyValue(asia, 124)]>
           but: was <[KeyValue(europe, 122), KeyValue(americas, 105), KeyValue(asia, 149), KeyValue(americas, 124), KeyValue(europe, 178), KeyValue(americas, 202), KeyValue(europe, 218), KeyValue(asia, 248)]>
      	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
      	at org.junit.Assert.assertThat(Assert.java:956)
      	at org.junit.Assert.assertThat(Assert.java:923)
      	at org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion(JoinIntegrationTest.java:258)
      

      https://builds.apache.org/job/kafka-trunk-git-pr-jdk7/4254/

      Attachments

        Activity

          guozhang Guozhang Wang added a comment -

          Seems like other test cases local state store was co-located with this test case and hence causing multiple over-counting. damianguy Is it still possible after the latest updates? Could you take a look?

          guozhang Guozhang Wang added a comment - Seems like other test cases local state store was co-located with this test case and hence causing multiple over-counting. damianguy Is it still possible after the latest updates? Could you take a look?
          damianguy Damian Guy added a comment -

          This should be fixed with the commit yesterday. I'll keep an eye on it to make sure.

          damianguy Damian Guy added a comment - This should be fixed with the commit yesterday. I'll keep an eye on it to make sure.
          ijuma Ismael Juma added a comment -

          damianguy, if it should be fixed, then feel free to close it. We can always reopen if it happens again.

          ijuma Ismael Juma added a comment - damianguy , if it should be fixed, then feel free to close it. We can always reopen if it happens again.
          damianguy Damian Guy added a comment - Should be fixed by: https://github.com/apache/kafka/commit/44c8308ab1a6b950c5b12386d7864881b5d052a0
          original-brownbear Armin Braun added a comment -

          I think this one is still pretty flaky. I see this (https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/2032/) kind of failure a lot locally and on Jenkins.
          Should we reopen this one maybe? Or add a new JIRA since the way it fails appears to have changed to:

          Error Message
          
          java.lang.AssertionError: Condition not met within timeout 30000. Expecting 3 records from topic output-topic-2 while only received 0: []
          Stacktrace
          
          java.lang.AssertionError: Condition not met within timeout 30000. Expecting 3 records from topic output-topic-2 while only received 0: []
          	at org.apache.kafka.test.TestUtils.waitForCondition(TestUtils.java:257)
          	at org.apache.kafka.streams.integration.utils.IntegrationTestUtils.waitUntilMinKeyValueRecordsReceived(IntegrationTestUtils.java:206)
          	at org.apache.kafka.streams.integration.utils.IntegrationTestUtils.waitUntilMinKeyValueRecordsReceived(IntegrationTestUtils.java:175)
          	at org.apache.kafka.streams.integration.KStreamKTableJoinIntegrationTest.shouldCountClicksPerRegion(KStreamKTableJoinIntegrationTest.java:297)
          	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
          	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
          	at java.lang.reflect.Method.invoke(Method.java:498)
          	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
          	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
          	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
          	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
          
          original-brownbear Armin Braun added a comment - I think this one is still pretty flaky. I see this ( https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/2032/ ) kind of failure a lot locally and on Jenkins. Should we reopen this one maybe? Or add a new JIRA since the way it fails appears to have changed to: Error Message java.lang.AssertionError: Condition not met within timeout 30000. Expecting 3 records from topic output-topic-2 while only received 0: [] Stacktrace java.lang.AssertionError: Condition not met within timeout 30000. Expecting 3 records from topic output-topic-2 while only received 0: [] at org.apache.kafka.test.TestUtils.waitForCondition(TestUtils.java:257) at org.apache.kafka.streams.integration.utils.IntegrationTestUtils.waitUntilMinKeyValueRecordsReceived(IntegrationTestUtils.java:206) at org.apache.kafka.streams.integration.utils.IntegrationTestUtils.waitUntilMinKeyValueRecordsReceived(IntegrationTestUtils.java:175) at org.apache.kafka.streams.integration.KStreamKTableJoinIntegrationTest.shouldCountClicksPerRegion(KStreamKTableJoinIntegrationTest.java:297) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)

          People

            damianguy Damian Guy
            ijuma Ismael Juma
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: