Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3764

AllocatedGB etc metrics incorrect if min-allocation-mb isn't a multiple of 1GB

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None

      Description

      MutableGaugeInt incremented as allocatedGB.incr(res.getMemory() / GB * containers);

      Setting yarn.scheduler.capacity.minimum-allocation-mb to 1536 - each increment is counted as 1GB.
      Trying to analyze the metrics - looks like the cluster is never over 67-68% utilized, depending on high ram requests.

      1. MAPREDUCE-3764.patch
        27 kB
        Arun C Murthy
      2. MAPREDUCE-3764.patch
        19 kB
        Arun C Murthy

        Activity

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Siddharth Seth
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development