[#MAPREDUCE-516] Fix the 'cluster drain' problem in the Capacity Scheduler wrt High RAM Jobs

Hadoop Map/Reduce

Fix the 'cluster drain' problem in the Capacity Scheduler wrt High RAM Jobs

Created: 03/Jun/09 12:38 AM Updated: 19/Aug/09 08:29 AM

Component/s:

None

Affects Version/s:

0.20.1

Fix Version/s:

0.21.0

Time Tracking:

Not Specified

File Attachments:

File Name	Date Attached	Attached By	Size
HADOOP-5964-11.patch	2009-06-23 05:00 PM	Hemanth Yamijala	165 kB
HADOOP-5964-12.patch	2009-06-24 02:09 PM	Hemanth Yamijala	168 kB
HADOOP-5964_0_20090602.patch	2009-06-03 12:58 AM	Arun C Murthy	31 kB
HADOOP-5964_10_20090622.patch	2009-06-23 07:21 AM	Arun C Murthy	162 kB
HADOOP-5964_11_20090623.patch	2009-06-24 06:15 AM	Arun C Murthy	174 kB
HADOOP-5964_1_20090608.patch	2009-06-09 12:46 AM	Arun C Murthy	54 kB
HADOOP-5964_1_20090623_yhadoop.patch	2009-06-24 02:48 PM	Arun C Murthy	170 kB
HADOOP-5964_2_20090609.patch	2009-06-09 06:54 AM	Arun C Murthy	68 kB
HADOOP-5964_2_20090629_yhadoop.patch	2009-06-30 12:17 AM	Arun C Murthy	170 kB
HADOOP-5964_2_20090629_yhadoop.patch	2009-06-29 10:17 PM	Arun C Murthy	170 kB
HADOOP-5964_4_20090615.patch	2009-06-15 08:11 AM	Arun C Murthy	84 kB
HADOOP-5964_6_20090617.patch	2009-06-17 06:31 AM	Arun C Murthy	145 kB
HADOOP-5964_7_20090618.patch	2009-06-18 07:31 AM	Arun C Murthy	148 kB
HADOOP-5964_8_20090618.patch	2009-06-19 06:59 AM	Arun C Murthy	163 kB
HADOOP-5964_9_20090619.patch	2009-06-22 06:07 AM	Arun C Murthy	163 kB
HADOOP-5964_9_20090619.patch	2009-06-22 04:22 AM	Arun C Murthy	164 kB
MAPREDUCE-516-Y20.patch	2009-06-25 10:22 AM	Sreekanth Ramakrishnan	170 kB
mr516-ydist.patch	2009-08-19 08:29 AM	Sreekanth Ramakrishnan	170 kB

Issue Links:

Blocker

This issue is blocked by:

~~HADOOP-5884~~ Capacity scheduler should account high memory jobs as using more capacity of the queue

Reference

This issue is related to:

~~HADOOP-5881~~ Simplify configuration related to task-memory-monitoring and memory-based scheduling

Hadoop Flags:	Reviewed, Incompatible change
Resolution Date:	24/Jun/09 02:43 PM

Description

« Hide

When a HighRAMJob turns up at the head of the queue, the current implementation of support for HighRAMJobs in the Capacity Scheduler has problem in that the scheduler stops assigning tasks to all TaskTrackers in the cluster until a HighRAMJob finds a suitable TaskTrackers for all its tasks.

This causes a severe utilization problem since effectively no new tasks are allowed to run until the HighRAMJob (at the head of the queue) gets slots.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Repository	Revision	Date	User	Message
ASF	#788036	Wed Jun 24 14:22:13 UTC 2009	yhemanth	~~MAPREDUCE-516~~. Fix the starvation problem in the Capacity Scheduler when running High RAM Jobs. Contributed by Arun Murthy.
				Files Changed
				MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/TaskScheduler.java MODIFY /hadoop/mapreduce/trunk/CHANGES.txt MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/JobCounter.properties MODIFY /hadoop/mapreduce/trunk/src/contrib/dynamic-scheduler/src/java/org/apache/hadoop/mapred/PriorityScheduler.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/MapTaskStatus.java MODIFY /hadoop/mapreduce/trunk/src/contrib/dynamic-scheduler/src/test/org/apache/hadoop/mapred/FakeDynamicScheduler.java MODIFY /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestJobQueueInformation.java ADD /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/server/jobtracker MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/JobInProgress.java MODIFY /hadoop/mapreduce/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/CapBasedLoadManager.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/ReduceTaskStatus.java MODIFY /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestJobHistory.java MODIFY /hadoop/mapreduce/trunk/src/webapps/job/taskdetails.jsp MODIFY /hadoop/mapreduce/trunk/src/contrib/capacity-scheduler/src/java/org/apache/hadoop/mapred/JobInitializationPoller.java MODIFY /hadoop/mapreduce/trunk/src/contrib/dynamic-scheduler/src/java/org/apache/hadoop/mapred/DynamicPriorityScheduler.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/TaskStatus.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/TaskInProgress.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/TaskTrackerStatus.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/InterTrackerProtocol.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/JobConf.java MODIFY /hadoop/mapreduce/trunk/src/webapps/job/jobfailures.jsp MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/MapTask.java MODIFY /hadoop/mapreduce/trunk/src/contrib/capacity-scheduler/src/test/org/apache/hadoop/mapred/TestCapacityScheduler.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/IsolationRunner.java MODIFY /hadoop/mapreduce/trunk/src/contrib/fairscheduler/src/java/org/apache/hadoop/mapred/FairScheduler.java MODIFY /hadoop/mapreduce/trunk/src/contrib/capacity-scheduler/src/java/org/apache/hadoop/mapred/CapacityTaskScheduler.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/ReduceTask.java ADD /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/server MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/Task.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/TaskTracker.java ADD /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/server/jobtracker/TaskTracker.java MODIFY /hadoop/mapreduce/trunk/src/contrib/capacity-scheduler/src/java/org/apache/hadoop/mapred/MemoryMatcher.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/LocalJobRunner.java MODIFY /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestResourceEstimation.java ADD /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/server/jobtracker/TaskTracker.java.orig MODIFY /hadoop/mapreduce/trunk/src/webapps/job/machines.jsp MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/JobTracker.java MODIFY /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestTTMemoryReporting.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapreduce/JobCounter.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/TaskUmbilicalProtocol.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/LimitTasksPerJobTaskScheduler.java MODIFY /hadoop/mapreduce/trunk/src/java/org/apache/hadoop/mapred/JobQueueTaskScheduler.java MODIFY /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestJobTrackerSafeMode.java MODIFY /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestJobQueueTaskScheduler.java MODIFY /hadoop/mapreduce/trunk/src/contrib/fairscheduler/src/test/org/apache/hadoop/mapred/TestFairScheduler.java MODIFY /hadoop/mapreduce/trunk/src/test/mapred/org/apache/hadoop/mapred/TestSpeculativeExecution.java