[HDDS-2076] Read fails because the block cannot be located in the container

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.4.0
• Fix Version/s: 0.5.0
• Component/s: Ozone Client, Ozone Datanode
• Labels: MiniOzoneChaosCluster pull-request-available
• Target Version/s: 0.4.1
• Assignee: Shashikant Banerjee
• Reporter: Mukul Kumar Singh
• Created: 03/Sep/19 06:11
• Updated: 24/Feb/20 20:56
• Resolved: 12/Sep/19 15:50

Description

Read fails as the client is not able to read the block from the container.

org.apache.hadoop.hdds.scm.container.common.helpers.StorageContainerException: Unable to find the block with bcsID 2515 .Container 7 bcsId is 0.
        at org.apache.hadoop.hdds.scm.storage.ContainerProtocolCalls.validateContainerResponse(ContainerProtocolCalls.java:536)
        at org.apache.hadoop.hdds.scm.storage.ContainerProtocolCalls.lambd2a0$getValid1a9to-08-30 12:51:20,081 | INFO  | SCMAudit | user=msingh | ip=192.168.0.r103 |List$0(ContainerP
rotocolCalls.java:569)

The client eventually exits here

2019-08-30 12:51:20,081 [pool-224-thread-6] ERROR ozone.MiniOzoneLoadGenerator (MiniOzoneLoadGenerator.java:readData(176)) - LOADGEN: Read key:pool-224-thread-6_330651 failed with ex
ception
ERROR ozone.MiniOzoneLoadGenerator (MiniOzoneLoadGenerator.java:load(121)) - LOADGEN: Exiting due to exception

Issue Links

• causes: HDDS-2132 TestKeyValueContainer is failing
• causes: HDDS-2133 TestOzoneContainer is failing
• links to: GitHub Pull Request #1410