[PIG-4698] Enable dynamic resource allocation/de-allocation on Yarn backends

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: spark-branch
• Fix Version/s: spark-branch
• Component/s: spark
• Labels: spork
• Assignee: Srikanth Sundarrajan
• Reporter: Srikanth Sundarrajan
• Created: 09/Oct/15 04:54
• Updated: 21/Jun/17 09:18
• Resolved: 27/Oct/15 03:40

Description

Resource elasticity needs to be enabled on Yarn backend to allow jobs to scale out better and provide better wall clock execution times, while unused resources should be released back to RM for use.

Issue Links

• links to: Review request