[YARN-3669] Attempt-failures validatiy interval should have a global admin configurable lower limit

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: resourcemanager
• Labels: newbie
• Assignee: Xuan Gong
• Reporter: Vinod Kumar Vavilapalli
• Created: 18/May/15 02:55
• Updated: 04/Feb/16 01:18

Description

Found this while reviewing YARN-3480.

When 'attemptFailuresValidityInterval'(introduced in YARN-611) is set to a small value, retried attempts might be very large. So we need to delete some attempts stored in RMStateStore and RMStateStore.

I think we need to have a lower limit on the failure-validaty interval to avoid situations like this.

Having this will avoid pardoning too-many failures in too-short a duration.