[YARN-2229] ContainerId can overflow with RM restart

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.6.0
• Component/s: resourcemanager
• Target Version/s: 2.6.0
• Hadoop Flags: Reviewed
• Assignee: Tsuyoshi Ozawa
• Reporter: Tsuyoshi Ozawa
• Created: 28/Jun/14 04:13
• Updated: 01/Dec/14 03:08
• Resolved: 12/Sep/14 17:46

Description

On YARN-2052, we changed containerId format: upper 10 bits are for epoch, lower 22 bits are for sequence number of Ids. This is for preserving semantics of ContainerId#getId(), ContainerId#toString(), ContainerId#compareTo(), ContainerId#equals, and ConverterUtils#toContainerId. One concern is epoch can overflow after RM restarts 1024 times.
To avoid the problem, its better to make containerId long. We need to define the new format of container Id with preserving backward compatibility on this JIRA.

Issue Links

• breaks: SLIDER-425 Build broken against 2.6.0-SNAPSHOT due to new abstract methods added by YARN-2229
• is related to: YARN-2052 ContainerId creation after work preserving restart is broken
• relates to: YARN-2182 Update ContainerId#toString() to avoid conflicts before and after RM restart