[HDFS-12830] Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: HDFS-7240
• Fix Version/s: HDFS-7240
• Component/s: ozone
• Labels: test
• Target Version/s: HDFS-7240
• Hadoop Flags: Reviewed
• Assignee: Yiqun Lin
• Reporter: Yiqun Lin
• Created: 17/Nov/17 02:57
• Updated: 26/Apr/18 21:55
• Resolved: 17/Nov/17 19:55

Description

The test TestOzoneRpcClient#testPutKeyRatisThreeNodes always fails in the feature branch. Stack trace:

2017-11-16 11:44:28,512 [IPC Server handler 7 on 43551] ERROR ratis.RatisManagerImpl (RatisManagerImpl.java:getPipeline(130))      - Get pipeline call failed. We are not able to find free nodes or operational pipeline.
2017-11-16 11:44:28,513 [IPC Server handler 7 on 43551] WARN  ipc.Server (Server.java:logException(2721)) - IPC Server handler 7 on 43551, call Call#679 Retry#0 org.apache.hadoop.ozone.protocol.ScmBlockLocationProtocol.allocateScmBlock from 172.17.0.2:42671
java.lang.NullPointerException
	at org.apache.hadoop.scm.container.common.helpers.ContainerInfo.getProtobuf(ContainerInfo.java:132)
	at org.apache.hadoop.ozone.scm.container.ContainerMapping.allocateContainer(ContainerMapping.java:221)
	at org.apache.hadoop.ozone.scm.block.BlockManagerImpl.preAllocateContainers(BlockManagerImpl.java:190)
	at org.apache.hadoop.ozone.scm.block.BlockManagerImpl.allocateBlock(BlockManagerImpl.java:292)
	at org.apache.hadoop.ozone.scm.StorageContainerManager.allocateBlock(StorageContainerManager.java:1047)
	at org.apache.hadoop.ozone.protocolPB.ScmBlockLocationProtocolServerSideTranslatorPB.allocateScmBlock(ScmBlockLocationProtocolServerSideTranslatorPB.java:107)
	at 

The warn log Get pipeline call failed. We are not able to find free nodes or operational pipeline. is the failed reason. This is broken by the change in HDFS-12756. It missed resetting datanode num.

-    cluster = new MiniOzoneCluster.Builder(conf).numDataNodes(5)
+    cluster = new MiniOzoneClassicCluster.Builder(conf)

Issue Links

• is broken by: HDFS-12756 Ozone: Add datanodeID to heartbeat responses and container protocol