[SPARK-10224] BlockGenerator may lost data in the last block

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.2.2, 1.3.1, 1.4.1, 1.5.0
• Fix Version/s: 1.5.1, 1.6.0
• Component/s: DStreams
• Target Version/s: 1.5.1, 1.6.0
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 25/Aug/15 13:26
• Updated: 23/Sep/15 08:28
• Resolved: 23/Sep/15 08:28

Description

There is a race condition in BlockGenerator that will lost data in the last block. See my PR for details.

Issue Links

• links to: [Github] Pull Request #8417 (zsxwing)