[HDDS-3064] Get Key is hung when READ delay is injected in chunk file path

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Labels: fault_injection pull-request-available
• Assignee: Shashikant Banerjee
• Reporter: Nilotpal Nandi
• Created: 24/Feb/20 14:55
• Updated: 23/May/20 17:09
• Resolved: 23/May/20 17:08

Description

Steps taken :

------------------

1. Mounted noise injection FUSE on all datanodes.
2. Write a key.
3. In one of the container replicas of the key, Inject READ delay of 5 seconds on chunk file directory path.
4. Run get Key operation.

Get Key operation is stuck and does not return any success/error .

Issue Links

• contains: HDDS-3266 Intermittent integration test failure due to DEADLINE_EXCEEDED
• contains: HDDS-3293 read operation failing when two container replicas are corrupted
• duplicates: HDDS-3285 MiniOzoneChaosCluster exits because of deadline exceeding
• incorporates: HDDS-3285 MiniOzoneChaosCluster exits because of deadline exceeding
• links to: GitHub Pull Request #673
• links to: GitHub Pull Request #738
• links to: GitHub Pull Request #767