[TEZ-3283] Add a max cap to the heap computation done by Tez

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Labels: newbie
• Target Version/s: 0.8.6
• Assignee: Muhammad Samir Khan
• Reporter: Siddharth Seth
• Created: 28/May/16 19:55
• Updated: 12/Jun/17 18:41

Description

Change the calculation to not use the fraction blindly. For large containers - .e.g 10GB - this ends up leaving 2G of the container unused / outside of the heap.
Instead we can add another parameter which indicates the max amount of memory to leave outside the heap - defaulting to 1G