[TEZ-3147] Intermediate mem-to-mem: Fix early exit when only one segment can fit into memory

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.1, 0.8.3
• Hadoop Flags: Reviewed
• Assignee: Rajesh Balamohan
• Reporter: Rajesh Balamohan
• Created: 27/Feb/16 01:48
• Updated: 18/May/16 04:55
• Resolved: 27/Feb/16 05:28

Description

Related to TEZ-1911 (since it got committed already, created this jira)

If there is only one segment left out in intermediate mem-to-mem merging, it does an early exit. But before that it should add the segment back to inMemoryMapOutput so that it can be considered for merging later.

Issue Links

• blocks: TEZ-3116 Umbrella ticket for shuffle fixes
• is related to: TEZ-1911 MergeManager's unconditionalReserve() should check for memory limits before allocating memory to IntermediateMemoryToMemoryMerger