[HDFS-8233] Fix DFSStripedOutputStream#getCurrentBlockGroupBytes when the last stripe is at the block group boundary

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: HDFS-7285
• Hadoop Flags: Reviewed
• Assignee: Jing Zhao
• Reporter: Jing Zhao
• Created: 23/Apr/15 19:59
• Updated: 30/Sep/15 19:38
• Resolved: 23/Apr/15 22:43

Description

Currently DFSStripedOutputStream#getCurrentBlockGroupBytes simply uses getBytesCurBlock of each streamer to calculate the block group size. This is wrong when the last stripe is at the block group boundary, since the bytesCurBlock is set to 0 if an internal block is finished.

For example, when the real block size is blockGroupSize - cellSize * (numDataBlocks - 1), i.e., the first internal block is full while the others are not, the getCurrentBlockGroupBytes returns wrong result and cause the write to fail.