Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
2.4.1
-
None
-
None
Description
ENV Details:
=========
3 queues : a(50%),b(25%),c(25%) ---> All max utilization is set to 100
2 Node cluster with total memory as 16GB
TestSteps:
=========
Execute following 3 jobs with different memory configurations for Map , reducer and AM task
./yarn jar wordcount-sleep.jar -Dmapreduce.job.queuename=a -Dwordcount.map.sleep.time=2000 -Dmapreduce.map.memory.mb=2048 -Dyarn.app.mapreduce.am.resource.mb=1024 -Dmapreduce.reduce.memory.mb=2048 /dir8 /preempt_85 (application_1405414066690_0023)
./yarn jar wordcount-sleep.jar -Dmapreduce.job.queuename=b -Dwordcount.map.sleep.time=2000 -Dmapreduce.map.memory.mb=2048 -Dyarn.app.mapreduce.am.resource.mb=2048 -Dmapreduce.reduce.memory.mb=2048 /dir2 /preempt_86 (application_1405414066690_0025)
./yarn jar wordcount-sleep.jar -Dmapreduce.job.queuename=c -Dwordcount.map.sleep.time=2000 -Dmapreduce.map.memory.mb=1024 -Dyarn.app.mapreduce.am.resource.mb=1024 -Dmapreduce.reduce.memory.mb=1024 /dir2 /preempt_62
Issue
=====
when 2GB memory is in reserved state totoal memory is shown as 15GB and used as 15GB ( while total memory is 16GB)
Attachments
Attachments
Issue Links
- is duplicated by
-
YARN-2285 Capacity scheduler root queue usage can show above 100% due to reserved container.
- Resolved