[YARN-5990] [Umbrella] Follow-up (phase-2) FairScheduler preemption improvements

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Karthik Kambatla
• Created: 09/Dec/16 22:25
• Updated: 09/Dec/16 22:25

Description

YARN-4752 overhauled FS preemption. This JIRA is to track follow-up minor improvements discussed in the design doc on YARN-4752.

The reason for creating this is primarily for better release notes around YARN-4752.

Sub-Tasks

• Verify app starvation under custom preemption thresholds and timeouts: Open
• Preemption should consider more resource-requests of a starved app if the initial set can not be satisfied: Open
• Add more restrictions In FairScheduler Preemption: Patch Available
• Shuffle nodes when selecting to be preempted nodes: Patch Available
• It's not reasonable to decide whether app is starved by fairShare: Patch Available
• FairScheduler: FSStarvedApps is not thread safe: Patch Available