[YARN-3769] Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 2.6.0, 2.7.0, 2.8.0
Fix Version/s: 2.8.0, 2.7.3, 3.0.0-alpha1
Component/s: capacityscheduler
Labels:
None

Target Version/s:

2.7.3, 2.6.5
Hadoop Flags:

Reviewed

Description

We are seeing the preemption monitor preempting containers from queue A and then seeing the capacity scheduler giving them immediately back to queue A. This happens quite often and causes a lot of churn.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

YARN-3769.001.branch-2.7.patch
31/Aug/15 19:20
8 kB
Eric Payne
YARN-3769.001.branch-2.8.patch
31/Aug/15 19:20
7 kB
Eric Payne
YARN-3769-branch-2.7.002.patch
03/Oct/15 22:18
24 kB
Eric Payne
YARN-3769-branch-2.002.patch
05/Oct/15 15:32
27 kB
Eric Payne
YARN-3769-branch-2.7.003.patch
10/Oct/15 15:51
24 kB
Eric Payne
YARN-3769.003.patch
15/Oct/15 21:23
29 kB
Eric Payne
YARN-3769.004.patch
02/Nov/15 17:36
30 kB
Eric Payne
YARN-3769.005.patch
12/Nov/15 03:10
28 kB
Eric Payne
YARN-3769-branch-2.7.005.patch
12/Nov/15 18:00
22 kB
Eric Payne
YARN-3769-branch-2.7.006.patch
17/Nov/15 21:35
23 kB
Eric Payne
YARN-3769-branch-2.7.007.patch
18/Nov/15 22:09
23 kB
Eric Payne
YARN-3769-branch-2.6.001.patch
01/Dec/15 19:21
24 kB
Eric Payne
YARN-3769-branch-2.6.002.patch
04/Feb/16 16:33
24 kB
Eric Payne

Issue Links

relates to

YARN-8509 Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

Patch Available

Activity

People

Assignee:: Eric Payne

Reporter:: Eric Payne

Votes:: 0 Vote for this issue

Watchers:: 16 Start watching this issue

Dates

Created:: 04/Jun/15 21:28

Updated:: 25/Oct/19 20:26

Resolved:: 21/Nov/15 00:44