[HDDS-9881] Intermittent address already in use in TestSecureContainerServer

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: test
• Labels: pull-request-available
• Assignee: Arafat Khan
• Reporter: Attila Doroszlai
• Created: 08/Dec/23 11:07
• Updated: 15/Dec/23 16:52
• Resolved: 15/Dec/23 16:52

Description

TestSecureContainerServer uses random ports and intermittently runs into:

org.apache.ratis.util.ExitUtils$ExitException: Failed to start Grpc server
	at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:141)
	at org.apache.ratis.util.ExitUtils.terminate(ExitUtils.java:151)
	at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:300)
	at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
	at org.apache.ratis.server.RaftServerRpcWithProxy.start(RaftServerRpcWithProxy.java:72)
	at org.apache.ratis.server.impl.RaftServerProxy.startImpl(RaftServerProxy.java:407)
	at org.apache.ratis.util.LifeCycle.startAndTransition(LifeCycle.java:270)
	at org.apache.ratis.server.impl.RaftServerProxy.start(RaftServerProxy.java:400)
	at org.apache.hadoop.ozone.container.common.transport.server.ratis.XceiverServerRatis.start(XceiverServerRatis.java:552)
	at org.apache.hadoop.ozone.container.server.TestSecureContainerServer.runTestClientServer(TestSecureContainerServer.java:250)
	at org.apache.hadoop.ozone.container.server.TestSecureContainerServer.runTestClientServerRatis(TestSecureContainerServer.java:223)
	at org.apache.hadoop.ozone.container.server.TestSecureContainerServer.testClientServerRatisGrpc(TestSecureContainerServer.java:201)
...
Caused by: java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:44005
	at org.apache.ratis.thirdparty.io.grpc.netty.NettyServer.start(NettyServer.java:326)
	at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:185)
	at org.apache.ratis.thirdparty.io.grpc.internal.ServerImpl.start(ServerImpl.java:94)
	at org.apache.ratis.grpc.server.GrpcService.startImpl(GrpcService.java:298)
	... 53 more
Caused by: org.apache.ratis.thirdparty.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use

Issue Links

• is related to: HDDS-7879 Intermittent BindException in HA integration tests
• is related to: HDDS-8581 Avoid random ports in integration tests
• is related to: HDDS-6122 Intermittent port conflict in TestSecureContainerServer
• links to: GitHub Pull Request #5782