Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1496

NoLeaderMasterFoundException are mishandled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.10.0
    • client
    • None

    Description

      The following test is flaky: org.kududb.client.TestRowResult

      Saw a failure on a Jenkins run: http://104.196.14.100/job/kudu-gerrit/1970/BUILD_TYPE=ASAN/testReport/junit/org.kududb.client/TestRowResult/org_kududb_client_TestRowResult/

      Error Message
      
      Master config (127.126.201.1:64030) has no leader.. Exceptions received: org.kududb.client.ConnectionResetException: [Peer Kudu Master - 127.126.201.1:64030] Connection reset on [id: 0x10e02648]
      
      Stacktrace
      
      org.kududb.client.NoLeaderMasterFoundException: Master config (127.126.201.1:64030) has no leader.. Exceptions received: org.kududb.client.ConnectionResetException: [Peer Kudu Master - 127.126.201.1:64030] Connection reset on [id: 0x10e02648]
      	at org.kududb.client.NoLeaderMasterFoundException.create(NoLeaderMasterFoundException.java:59)
      	at org.kududb.client.GetMasterRegistrationReceived.incrementCountAndCheckExhausted(GetMasterRegistrationReceived.java:123)
      	at org.kududb.client.GetMasterRegistrationReceived.access$300(GetMasterRegistrationReceived.java:42)
      	at org.kududb.client.GetMasterRegistrationReceived$GetMasterRegistrationErrCB.call(GetMasterRegistrationReceived.java:209)
      	at org.kududb.client.GetMasterRegistrationReceived$GetMasterRegistrationErrCB.call(GetMasterRegistrationReceived.java:198)
      	at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
      	at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
      	at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
      	at org.kududb.client.KuduRpc.handleCallback(KuduRpc.java:194)
      	at org.kududb.client.KuduRpc.errback(KuduRpc.java:214)
      	at org.kududb.client.TabletClient.failOrRetryRpc(TabletClient.java:710)
      	at org.kududb.client.TabletClient.failOrRetryRpcs(TabletClient.java:695)
      	at org.kududb.client.TabletClient.cleanup(TabletClient.java:684)
      	at org.kududb.client.TabletClient.channelClosed(TabletClient.java:654)
      	at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88)
      	at org.kududb.client.TabletClient.handleUpstream(TabletClient.java:635)
      	at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
      	at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
      	at org.jboss.netty.handler.timeout.ReadTimeoutHandler.channelClosed(ReadTimeoutHandler.java:176)
      	at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88)
      	at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
      	at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
      	at org.kududb.client.AsyncKuduClient$TabletClientPipeline.sendUpstream(AsyncKuduClient.java:1763)
      	at org.jboss.netty.channel.Channels.fireChannelClosed(Channels.java:468)
      	at org.jboss.netty.channel.Channels$6.run(Channels.java:457)
      	at org.jboss.netty.channel.socket.ChannelRunnableWrapper.run(ChannelRunnableWrapper.java:40)
      	at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391)
      	at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315)
      	at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
      	at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
      	at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
      	at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      Caused by: org.kududb.client.ConnectionResetException: [Peer Kudu Master - 127.126.201.1:64030] Connection reset on [id: 0x10e02648]
      	at org.kududb.client.TabletClient.cleanup(TabletClient.java:681)
      	at org.kududb.client.TabletClient.channelClosed(TabletClient.java:654)
      	at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88)
      	at org.kududb.client.TabletClient.handleUpstream(TabletClient.java:635)
      	at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
      	at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
      	at org.jboss.netty.handler.timeout.ReadTimeoutHandler.channelClosed(ReadTimeoutHandler.java:176)
      	at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88)
      	at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
      	at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
      	at org.kududb.client.AsyncKuduClient$TabletClientPipeline.sendUpstream(AsyncKuduClient.java:1763)
      	at org.jboss.netty.channel.Channels.fireChannelClosed(Channels.java:468)
      	at org.jboss.netty.channel.Channels$6.run(Channels.java:457)
      	at org.jboss.netty.channel.socket.ChannelRunnableWrapper.run(ChannelRunnableWrapper.java:40)
      	at org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391)
      	at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315)
      	at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
      	at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
      	at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
      	at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
      

      Attachments

        Activity

          People

            jdcryans Jean-Daniel Cryans
            mpercy Mike Percy
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: