Details
-
New Feature
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
Description
The current Hadoop YARN resource management logic assumes per node resource is static during the lifetime of the NM process. Allowing run-time configuration on per node resource will give us finer granularity of resource elasticity. This allows Hadoop workloads to coexist with other workloads on the same hardware efficiently, whether or not the environment is virtualized. More background and design details can be found in attached proposal.
Attachments
Attachments
Issue Links
- blocks
-
YARN-914 (Umbrella) Support graceful decommission of nodemanager
-
- Open
-
- is related to
-
YARN-160 nodemanagers should obtain cpu/memory values from underlying OS
-
- Resolved
-
- relates to
-
YARN-45 [Preemption] Scheduler feedback to AM to release containers
-
- Closed
-
-
MAPREDUCE-4584 Umbrella: Preemption and restart of MapReduce tasks
-
- Open
-
-
MAPREDUCE-4900 Dynamic configuration for task slots on TT
-
- Open
-
-
YARN-3482 Report NM resource capacity in heartbeat
-
- Open
-
- supercedes
-
HADOOP-9165 Dynamic Resource/Slot Configuration on NM/TT
-
- Resolved
-