[TEZ-1945] Remove 2 GB memlimit restriction in MergeManager

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.0
• Target Version/s: 0.7.0
• Hadoop Flags: Reviewed
• Assignee: Rajesh Balamohan
• Reporter: Rajesh Balamohan
• Created: 14/Jan/15 09:15
• Updated: 30/Jun/15 04:52
• Resolved: 15/Jan/15 01:22

Description

In certain situations (data coming in larger chunks, but yet to complete), fetchers might wait in MerManager.waitForShuffleToMergeMemory() for memory to become available.

Removing the 2 GB resitrction on MergeManager.memlimit would help in such situations.