[YARN-4161] Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration - ASF JIRA

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.9.0, 3.0.0-beta1
Component/s: capacity scheduler
Labels:
- oct16-medium

Description

Capacity Scheduler right now schedules multiple containers per heart beat if there are more resources available in the node.
This approach works fine however in some cases its not distribute the load across the cluster hence throughput of the cluster suffers. I am adding feature to drive that using configuration by that we can control the number of containers assigned per heart beat.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

YARN-4161.002.patch
30/Jun/17 21:26
18 kB
Wei Yan
YARN-4161.003.patch
19/Jul/17 16:32
17 kB
Wei Yan
YARN-4161.004.patch
19/Jul/17 19:56
19 kB
Wei Yan
YARN-4161.005.patch
19/Jul/17 21:09
18 kB
Wei Yan
YARN-4161.006.patch
25/Jul/17 16:54
18 kB
Wei Yan
YARN-4161.branch-2.006.patch
07/Aug/17 18:35
18 kB
Wangda Tan
YARN-4161.patch
05/Jan/16 21:20
16 kB
Mayank Bansal
YARN-4161.patch.1
27/Jun/17 21:47
16 kB
Wei Yan

Issue Links

is related to

YARN-6851 Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat

Resolved

relates to

YARN-10860 Make max container per heartbeat configs refreshable

Resolved

Activity

People

Assignee:: Wei Yan

Reporter:: Mayank Bansal

Votes:: 2 Vote for this issue

Watchers:: 11 Start watching this issue

Dates

Created:: 15/Sep/15 17:46

Updated:: 19/Jul/21 20:16

Resolved:: 07/Aug/17 21:09