Uploaded image for project: 'Ratis'
  1. Ratis
  2. RATIS-1628

Fix "Address already in use" failure in TestMultiRaftGroup

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.4.0, 3.0.0
    • test
    • None

    Description

      https://github.com/apache/ratis/runs/7412868354?check_suite_focus=true

       

      [INFO] Running org.apache.ratis.TestMultiRaftGroup
       
      Error: Tests run: 5, Failures: 3, Errors: 1, Skipped: 0, Time elapsed: 33.901 s <<< FAILURE! - in org.apache.ratis.TestMultiRaftGroup
       
      Error: testMultiRaftGroup[1](org.apache.ratis.TestMultiRaftGroup) Time elapsed: 1.447 s <<< ERROR!
       
      org.apache.ratis.util.ExitUtils$ExitException: Failed to start Grpc server
       
      at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:141)
       
      at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:151)
       
      at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:260)
       
      at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
       
      at org.apache.ratis.server.RaftServerRpcWithProxy.start(RaftServerRpcWithProxy.java:72)
       
      at org.apache.ratis.server.impl.RaftServerProxy.startImpl(RaftServerProxy.java:386)
       
      at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
       
      at org.apache.ratis.server.impl.RaftServerProxy.start(RaftServerProxy.java:379)
       
      at org.apache.ratis.server.impl.MiniRaftCluster.startServers(MiniRaftCluster.java:452)
       
      at org.apache.ratis.server.impl.MiniRaftCluster.start(MiniRaftCluster.java:312)
       
      at org.apache.ratis.server.impl.GroupManagementBaseTest.runMultiGroupTest(GroupManagementBaseTest.java:263)
       
      at org.apache.ratis.TestMultiRaftGroup.runTestMultiRaftGroup(TestMultiRaftGroup.java:74)
       
      at org.apache.ratis.TestMultiRaftGroup.runTestMultiRaftGroup(TestMultiRaftGroup.java:60)
       
      at org.apache.ratis.TestMultiRaftGroup.testMultiRaftGroup(TestMultiRaftGroup.java:56)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
       
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
       
      at java.lang.reflect.Method.invoke(Method.java:498)
       
      at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
       
      at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
       
      at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
       
      at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
       
      at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
       
      at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
       
      at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
       
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
       
      at java.lang.Thread.run(Thread.java:750)
       
      Caused by: java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:38545
       
      at org.apache.ratis.thirdparty.io.grpc.netty.NettyServer.start(NettyServer.java:328)
       
      at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:183)
       
      at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:92)
       
      at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:258)
       
      ... 24 more
       
      Caused by: org.apache.ratis.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use
       
       
       
      Error: testMultiRaftGroup[1](org.apache.ratis.TestMultiRaftGroup) Time elapsed: 1.448 s <<< FAILURE!
       
      java.lang.AssertionError: Unexpected exit.
       
      at org.apache.ratis.util.ExitUtils.assertNotTerminated(ExitUtils.java:109)
       
      at org.apache.ratis.BaseTest.assertNoFailures(BaseTest.java:89)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
       
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
       
      at java.lang.reflect.Method.invoke(Method.java:498)
       
      at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
       
      at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
       
      at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
       
      at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46)
       
      at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
       
      at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
       
      at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
       
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
       
      at java.lang.Thread.run(Thread.java:750)
       
      Caused by: org.apache.ratis.util.ExitUtils$ExitException: Failed to start Grpc server
       
      at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:141)
       
      at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:151)
       
      at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:260)
       
      at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
       
      at org.apache.ratis.server.RaftServerRpcWithProxy.start(RaftServerRpcWithProxy.java:72)
       
      at org.apache.ratis.server.impl.RaftServerProxy.startImpl(RaftServerProxy.java:386)
       
      at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
       
      at org.apache.ratis.server.impl.RaftServerProxy.start(RaftServerProxy.java:379)
       
      at org.apache.ratis.server.impl.MiniRaftCluster.startServers(MiniRaftCluster.java:452)
       
      at org.apache.ratis.server.impl.MiniRaftCluster.start(MiniRaftCluster.java:312)
       
      at org.apache.ratis.server.impl.GroupManagementBaseTest.runMultiGroupTest(GroupManagementBaseTest.java:263)
       
      at org.apache.ratis.TestMultiRaftGroup.runTestMultiRaftGroup(TestMultiRaftGroup.java:74)
       
      at org.apache.ratis.TestMultiRaftGroup.runTestMultiRaftGroup(TestMultiRaftGroup.java:60)
       
      at org.apache.ratis.TestMultiRaftGroup.testMultiRaftGroup(TestMultiRaftGroup.java:56)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
       
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
       
      at java.lang.reflect.Method.invoke(Method.java:498)
       
      at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
       
      at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
       
      at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
       
      at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
       
      at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
       
      ... 4 more
       
      Caused by: java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:38545
       
      at org.apache.ratis.thirdparty.io.grpc.netty.NettyServer.start(NettyServer.java:328)
       
      at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:183)
       
      at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:92)
       
      at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:258)
       
      ... 24 more
       
      Caused by: org.apache.ratis.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use
       
       
       
      Error: testMultiRaftGroup[2](org.apache.ratis.TestMultiRaftGroup) Time elapsed: 11.46 s <<< FAILURE!
       
      java.lang.AssertionError: Unexpected exit.
       
      at org.apache.ratis.util.ExitUtils.assertNotTerminated(ExitUtils.java:109)
       
      at org.apache.ratis.server.impl.MiniRaftCluster.shutdown(MiniRaftCluster.java:800)
       
      at org.apache.ratis.server.impl.GroupManagementBaseTest.runMultiGroupTest(GroupManagementBaseTest.java:339)
       
      at org.apache.ratis.TestMultiRaftGroup.runTestMultiRaftGroup(TestMultiRaftGroup.java:74)
       
      at org.apache.ratis.TestMultiRaftGroup.runTestMultiRaftGroup(TestMultiRaftGroup.java:60)
       
      at org.apache.ratis.TestMultiRaftGroup.testMultiRaftGroup(TestMultiRaftGroup.java:56)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
       
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
       
      at java.lang.reflect.Method.invoke(Method.java:498)
       
      at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
       
      at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
       
      at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
       
      at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
       
      at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
       
      at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
       
      at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
       
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
       
      at java.lang.Thread.run(Thread.java:750)
       
      Caused by: org.apache.ratis.util.ExitUtils$ExitException: Failed to start Grpc server
       
      at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:141)
       
      at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:151)
       
      at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:260)
       
      at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
       
      at org.apache.ratis.server.RaftServerRpcWithProxy.start(RaftServerRpcWithProxy.java:72)
       
      at org.apache.ratis.server.impl.RaftServerProxy.startImpl(RaftServerProxy.java:386)
       
      at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
       
      at org.apache.ratis.server.impl.RaftServerProxy.start(RaftServerProxy.java:379)
       
      at org.apache.ratis.server.impl.MiniRaftCluster.startServers(MiniRaftCluster.java:452)
       
      at org.apache.ratis.server.impl.MiniRaftCluster.start(MiniRaftCluster.java:312)
       
      at org.apache.ratis.server.impl.GroupManagementBaseTest.runMultiGroupTest(GroupManagementBaseTest.java:263)
       
      ... 16 more
       
      Caused by: java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:38545
       
      at org.apache.ratis.thirdparty.io.grpc.netty.NettyServer.start(NettyServer.java:328)
       
      at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:183)
       
      at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:92)
       
      at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:258)
       
      ... 24 more
       
      Caused by: org.apache.ratis.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use
       
       
       
      Error: testMultiRaftGroup[2](org.apache.ratis.TestMultiRaftGroup) Time elapsed: 11.461 s <<< FAILURE!
       
      java.lang.AssertionError: Unexpected exit.
       
      at org.apache.ratis.util.ExitUtils.assertNotTerminated(ExitUtils.java:109)
       
      at org.apache.ratis.BaseTest.assertNoFailures(BaseTest.java:89)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
       
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
       
      at java.lang.reflect.Method.invoke(Method.java:498)
       
      at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
       
      at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
       
      at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
       
      at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46)
       
      at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
       
      at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
       
      at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
       
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
       
      at java.lang.Thread.run(Thread.java:750)
       
      Caused by: org.apache.ratis.util.ExitUtils$ExitException: Failed to start Grpc server
       
      at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:141)
       
      at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:151)
       
      at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:260)
       
      at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
       
      at org.apache.ratis.server.RaftServerRpcWithProxy.start(RaftServerRpcWithProxy.java:72)
       
      at org.apache.ratis.server.impl.RaftServerProxy.startImpl(RaftServerProxy.java:386)
       
      at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
       
      at org.apache.ratis.server.impl.RaftServerProxy.start(RaftServerProxy.java:379)
       
      at org.apache.ratis.server.impl.MiniRaftCluster.startServers(MiniRaftCluster.java:452)
       
      at org.apache.ratis.server.impl.MiniRaftCluster.start(MiniRaftCluster.java:312)
       
      at org.apache.ratis.server.impl.GroupManagementBaseTest.runMultiGroupTest(GroupManagementBaseTest.java:263)
       
      at org.apache.ratis.TestMultiRaftGroup.runTestMultiRaftGroup(TestMultiRaftGroup.java:74)
       
      at org.apache.ratis.TestMultiRaftGroup.runTestMultiRaftGroup(TestMultiRaftGroup.java:60)
       
      at org.apache.ratis.TestMultiRaftGroup.testMultiRaftGroup(TestMultiRaftGroup.java:56)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
       
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
       
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
       
      at java.lang.reflect.Method.invoke(Method.java:498)
       
      at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
       
      at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
       
      at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
       
      at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
       
      at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
       
      ... 4 more
       
      Caused by: java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:38545
       
      at org.apache.ratis.thirdparty.io.grpc.netty.NettyServer.start(NettyServer.java:328)
       
      at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:183)
       
      at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:92)
       
      at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:258)
       
      ... 24 more
       
      Caused by: org.apache.ratis.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use
       
       
       
      [INFO]
       
      [INFO] Results:
       
      [INFO]
       
      Error: Failures:
       
      Error: org.apache.ratis.TestMultiRaftGroup.testMultiRaftGroup[2](org.apache.ratis.TestMultiRaftGroup)
       
      Error: Run 1: TestMultiRaftGroup.testMultiRaftGroup:56->runTestMultiRaftGroup:60->runTestMultiRaftGroup:74 Unexpected exit.
       
      Error: Run 2: TestMultiRaftGroup>BaseTest.assertNoFailures:89 Unexpected exit.
       
      [INFO]
       
      Error: Errors:
       
      Error: org.apache.ratis.TestMultiRaftGroup.testMultiRaftGroup[1](org.apache.ratis.TestMultiRaftGroup)
       
      Error: Run 1: TestMultiRaftGroup.testMultiRaftGroup:56->runTestMultiRaftGroup:60->runTestMultiRaftGroup:74 » Exit
       
      Error: Run 2: TestMultiRaftGroup>BaseTest.assertNoFailures:89 Unexpected exit.
       
      [INFO]
       
      [INFO]
       
      Error: Tests run: 23, Failures: 1, Errors: 1, Skipped: 0

      Attachments

        Issue Links

          links to

          Web Link GitHub Pull Request #685

          Activity

            People

              Sammi Sammi Chen
              Sammi Sammi Chen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m