[YARN-3417] AM to be able to exit with a request saying "restart me with these (possibly updated) resource requirements"

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.7.0
• Component/s: resourcemanager
• Assignee: Varun Saxena
• Reporter: Steve Loughran
• Created: 30/Mar/15 10:47
• Updated: 08/Sep/17 19:30

Description

If an AM wants to reconfigure itself or restart with new resources, there's no way to do this without the active participation of a client.

It can call System.exit and rely on YARN to restart it -but that counts as a failure and may lose the entire app. furthermore, that doesn't allow the AM to resize itself.

A simple exit-code to be interpreted as restart-without-failure could handle the first case; an explicit call to indicate restart, including potentially new resource/label requirements, could be more reliabile, and certainly more flexible.

Issue Links

• blocks: REEF-705 Support updating resources for Driver
• blocks: YARN-896 Roll up for long-lived services in YARN
• is related to: YARN-4470 [Umbrella] Application Master in-place upgrade