Description
When TTs are decommissioned for non-fault reasons (capacity change etc.), it's desirable to minimize the impact to running jobs.
Currently if a TT is decommissioned, all running tasks on the TT need to be rescheduled on other TTs. Further more, for finished map tasks, if their map output are not fetched by the reducers of the job, these map tasks will need to be rerun as well.
We propose to introduce a mechanism to optionally gracefully decommission a tasktracker.
Attachments
Attachments
Issue Links
- is blocked by
-
MAPREDUCE-4900 Dynamic configuration for task slots on TT
-
- Open
-
-
HADOOP-9160 Adopt Jolokia as the JMX HTTP/JSON bridge.
-
- Open
-
- is related to
-
-
- Open
-