Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3764

AllocatedGB etc metrics incorrect if min-allocation-mb isn't a multiple of 1GB

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None

      Description

      MutableGaugeInt incremented as allocatedGB.incr(res.getMemory() / GB * containers);

      Setting yarn.scheduler.capacity.minimum-allocation-mb to 1536 - each increment is counted as 1GB.
      Trying to analyze the metrics - looks like the cluster is never over 67-68% utilized, depending on high ram requests.

        Attachments

        1. MAPREDUCE-3764.patch
          27 kB
          Arun C Murthy
        2. MAPREDUCE-3764.patch
          19 kB
          Arun C Murthy

          Activity

            People

            • Assignee:
              acmurthy Arun C Murthy
              Reporter:
              sseth Siddharth Seth
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: