Hadoop YARN
  1. Hadoop YARN
  2. YARN-177

CapacityScheduler - adding a queue while the RM is running has wacky results

    Details

      Description

      Adding a queue to the capacity scheduler while the RM is running and then running a job in the queue added results in very strange behavior. The cluster Total Memory can either decrease or increase. We had a cluster where total memory decreased to almost 1/6th the capacity. Running on a small test cluster resulted in the capacity going up by simply adding a queue and running wordcount.

      Looking at the RM logs, used memory can go negative but other logs show the number positive:

      2012-10-21 22:56:44,796 [ResourceManager Event Processor] INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.0375 absoluteUsedCapacity=0.0375 used=memory: 7680 cluster=memory: 204800

      2012-10-21 22:56:45,831 [ResourceManager Event Processor] INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: completedContainer queue=root usedCapacity=-0.0225 absoluteUsedCapacity=-0.0225 used=memory: -4608 cluster=memory: 204800

      1. YARN-177.patch
        16 kB
        Arun C Murthy
      2. YARN-177.patch
        11 kB
        Arun C Murthy
      3. YARN-177.patch
        8 kB
        Thomas Graves
      4. YARN-177.patch
        8 kB
        Arun C Murthy

        Activity

        Thomas Graves created issue -
        Arun C Murthy made changes -
        Field Original Value New Value
        Assignee Thomas Graves [ tgraves ] Arun C Murthy [ acmurthy ]
        Arun C Murthy made changes -
        Attachment YARN-177.patch [ 12550363 ]
        Arun C Murthy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 2.0.3-alpha [ 12323272 ]
        Fix Version/s 0.23.5 [ 12323311 ]
        Thomas Graves made changes -
        Attachment YARN-177.patch [ 12550459 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Arun C Murthy made changes -
        Attachment YARN-177.patch [ 12550499 ]
        Arun C Murthy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Arun C Murthy made changes -
        Attachment YARN-177.patch [ 12550506 ]
        Arun C Murthy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Thomas Graves made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 3.0.0 [ 12323268 ]
        Resolution Fixed [ 1 ]
        Thomas Graves made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Allen Wittenauer made changes -
        Fix Version/s 3.0.0 [ 12323268 ]

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Thomas Graves
          • Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development