Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3764

AllocatedGB etc metrics incorrect if min-allocation-mb isn't a multiple of 1GB

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.23.0
    • 0.23.1
    • mrv2
    • None

    Description

      MutableGaugeInt incremented as allocatedGB.incr(res.getMemory() / GB * containers);

      Setting yarn.scheduler.capacity.minimum-allocation-mb to 1536 - each increment is counted as 1GB.
      Trying to analyze the metrics - looks like the cluster is never over 67-68% utilized, depending on high ram requests.

      Attachments

        1. MAPREDUCE-3764.patch
          27 kB
          Arun Murthy
        2. MAPREDUCE-3764.patch
          19 kB
          Arun Murthy

        Activity

          People

            acmurthy Arun Murthy
            sseth Siddharth Seth
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: