[YARN-5049] Extend NMStateStore to save queued container information

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: nodemanager, resourcemanager
• Hadoop Flags: Incompatible change

Release Note

This breaks rolling upgrades because it changes the major version of the NM state store schema. Therefore when a new NM comes up on an old state store it crashes.

The state store versions for this change have been updated in YARN-6798.

• Assignee: Arun Suresh
• Reporter: Konstantinos Karanasos
• Created: 06/May/16 00:26
• Updated: 13/Nov/17 23:08
• Resolved: 12/Nov/17 18:19

Description

This JIRA is about extending the NMStateStore to save queued container information whenever a new container is added to the NM queue.
It also removes the information from the state store when the queued container starts its execution.

Issue Links

• blocks: YARN-6798 Fix NM startup failure with old state store due to version mismatch
• is related to: YARN-5547 NMLeveldbStateStore should be more tolerant of unknown keys