[AMBARI-9064] Change retry settings in Ambari installer for nm connect retry

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: ambari-server
• Epic Link: Ambari: Rolling Upgrade
• Assignee: Dmitry Lysnichenko
• Reporter: Dmitry Lysnichenko
• Created: 09/Jan/15 15:37
• Updated: 09/Jan/15 17:27
• Resolved: 09/Jan/15 15:59

Description

we need to change the nm retry settings to resolve the bug. The proposed new settings in yarn-site.xml are:
yarn.client.nodemanager-connect.max-wait-ms = 60,000
yarn.client.nodemanager-connect.retry-interval-ms = 10,000

If the underlying rpc retry takes 1 sec * 50 times to finish (50 secs), this will make each round of retry to be 10 + 50 secs = 1 minute. From the code, there will be 60,000 / 10,000 = 6 times of retries. So, in total, if the node manager accidentally crashed and never goes up, we well retry 1 minute * 6 times = 6 minutes. The whole calculation is based on the rpc settings (50 times, 1 sec sleep time),

Issue Links

• links to: review board