[HDFS-9098] Erasure coding: emulate race conditions among striped streamers in write pipeline

• Type: Sub-task
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0-alpha1
• Component/s: erasure-coding
• Assignee: Zhe Zhang
• Reporter: Zhe Zhang
• Created: 17/Sep/15 17:30
• Updated: 22/Oct/18 20:56

Description

Apparently the interleaving of events among StripedDataStreamer's is very tricky to handle. walter.k.su and jingzhao have discussed several race conditions under HDFS-9040.

Let's use FaultInjector to emulate different combinations of interleaved events.

In particular, we should consider inject delays in the following places:

1. Streamer#endBlock
2. Streamer#locateFollowingBlock
3. Streamer#updateBlockForPipeline
4. Streamer#updatePipeline
5. OutputStream#writeChunk
6. OutputStream#close

Issue Links

• relates to: HDFS-9040 Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)