Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2054 Fix Kafka transient unit test failures
  3. KAFKA-4143

Transient failure in kafka.server.SaslSslReplicaFetchTest.testReplicaFetcherThread

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • unit tests
    • None

    Description

      Example: https://builds.apache.org/job/kafka-trunk-git-pr-jdk7/5471/testReport/junit/kafka.server/SaslSslReplicaFetchTest/testReplicaFetcherThread/

      java.lang.AssertionError: Partition [foo,0] metadata not propagated after 15000 ms
      	at org.junit.Assert.fail(Assert.java:88)
      	at kafka.utils.TestUtils$.waitUntilTrue(TestUtils.scala:752)
      	at kafka.utils.TestUtils$.waitUntilMetadataIsPropagated(TestUtils.scala:794)
      	at kafka.utils.TestUtils$$anonfun$createTopic$1.apply(TestUtils.scala:228)
      	at kafka.utils.TestUtils$$anonfun$createTopic$1.apply(TestUtils.scala:227)
      	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
      	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
      	at scala.collection.immutable.Range.foreach(Range.scala:141)
      	at scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
      	at scala.collection.AbstractTraversable.map(Traversable.scala:105)
      	at kafka.utils.TestUtils$.createTopic(TestUtils.scala:227)
      	at kafka.server.BaseReplicaFetchTest$$anonfun$testReplicaFetcherThread$2.apply(BaseReplicaFetchTest.scala:62)
      	at kafka.server.BaseReplicaFetchTest$$anonfun$testReplicaFetcherThread$2.apply(BaseReplicaFetchTest.scala:61)
      	at scala.collection.immutable.List.foreach(List.scala:318)
      	at kafka.server.BaseReplicaFetchTest.testReplicaFetcherThread(BaseReplicaFetchTest.scala:61)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
      	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
      	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
      	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
      	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
      	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
      	at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
      	at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
      	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
      	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:109)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
      	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
      	at org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:377)
      	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:54)
      	at org.gradle.internal.concurrent.StoppableExecutorImpl$1.run(StoppableExecutorImpl.java:40)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      Standard Output
      
      [2016-09-07 08:26:40,921] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:26:41,427] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka4797895085845125665.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
      principal is kafka/localhost@EXAMPLE.COM
      Will use keytab
      Commit Succeeded 
      
      [2016-09-07 08:26:42,106] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:27:14,546] WARN Client session timed out, have not heard from server in 32129ms for sessionid 0x15703c1958b0001 (org.apache.zookeeper.ClientCnxn:1108)
      [2016-09-07 08:27:14,547] WARN Client session timed out, have not heard from server in 32246ms for sessionid 0x15703c1958b0002 (org.apache.zookeeper.ClientCnxn:1108)
      [2016-09-07 08:27:14,546] WARN Client session timed out, have not heard from server in 32162ms for sessionid 0x15703c1958b0000 (org.apache.zookeeper.ClientCnxn:1108)
      [2016-09-07 08:27:14,559] WARN caught end of stream exception (org.apache.zookeeper.server.NIOServerCnxn:357)
      EndOfStreamException: Unable to read additional data from client sessionid 0x15703c1958b0001, likely client has closed socket
      	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:230)
      	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
      	at java.lang.Thread.run(Thread.java:745)
      [2016-09-07 08:27:14,560] WARN Ignoring unexpected runtime exception (org.apache.zookeeper.server.NIOServerCnxnFactory:213)
      java.nio.channels.CancelledKeyException
      	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
      	at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
      	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:182)
      	at java.lang.Thread.run(Thread.java:745)
      [2016-09-07 08:29:05,048] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:29:05,067] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:29:05,067] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:29:05,074] WARN Unable to reconnect to ZooKeeper service, session 0x15703c1958b0000 has expired (org.apache.zookeeper.ClientCnxn:1285)
      [2016-09-07 08:29:05,079] WARN Unable to reconnect to ZooKeeper service, session 0x15703c1958b0001 has expired (org.apache.zookeeper.ClientCnxn:1285)
      [2016-09-07 08:29:05,080] WARN Unable to reconnect to ZooKeeper service, session 0x15703c1958b0002 has expired (org.apache.zookeeper.ClientCnxn:1285)
      [2016-09-07 08:29:05,090] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:29:05,091] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:29:05,096] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:29:09,697] WARN Client session timed out, have not heard from server in 4595ms for sessionid 0x15703c1958b0004 (org.apache.zookeeper.ClientCnxn:1108)
      [2016-09-07 08:29:09,751] WARN caught end of stream exception (org.apache.zookeeper.server.NIOServerCnxn:357)
      EndOfStreamException: Unable to read additional data from client sessionid 0x15703c1958b0004, likely client has closed socket
      	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:230)
      	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
      	at java.lang.Thread.run(Thread.java:745)
      [2016-09-07 08:29:13,752] WARN Client session timed out, have not heard from server in 4002ms for sessionid 0x15703c1958b0005 (org.apache.zookeeper.ClientCnxn:1108)
      [2016-09-07 08:29:34,730] WARN Exception causing close of session 0x15703c1958b0005 due to java.nio.channels.CancelledKeyException (org.apache.zookeeper.server.NIOServerCnxn:346)
      [2016-09-07 08:29:35,724] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:29:35,726] WARN Unable to reconnect to ZooKeeper service, session 0x15703c1958b0004 has expired (org.apache.zookeeper.ClientCnxn:1285)
      [2016-09-07 08:29:35,729] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:29:35,961] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      [2016-09-07 08:29:35,965] WARN Unable to reconnect to ZooKeeper service, session 0x15703c1958b0005 has expired (org.apache.zookeeper.ClientCnxn:1285)
      [2016-09-07 08:29:36,013] WARN SASL configuration failed: javax.security.auth.login.LoginException: No JAAS configuration section named 'Client' was found in specified JAAS configuration file: '/tmp/kafka1752529876984626701.tmp'. Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn:1014)
      Debug is  true storeKey true useTicketCache false useKeyTab true doNotPrompt false ticketCache is null isInitiator true KeyTab is /tmp/kafka4797895085845125665.tmp refreshKrb5Config is false principal is kafka/localhost@EXAMPLE.COM tryFirstPass is false useFirstPass is false storePass is false clearPass is false
      principal is kafka/localhost@EXAMPLE.COM
      Will use keytab
      Commit Succeeded 
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            guozhang Guozhang Wang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: