Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1735

For FairScheduler AvailableMB in QueueMetrics is the same as AllocateMB

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • fairscheduler

    Description

      in monitoring graphs the AvailableMB of each queue regularly spikes between the AllocatedMB and the entire cluster capacity.
      This cannot be correct since AvailableMB should never be more than the queue max allocation. The spikes are quite confusing since the availableMB is set as the fair share of each queue and the fair share of each queue is bond by their allowed max resource.

      Other than the spiking, the availableMB is always equal to allocatedMB. I think this is not very useful, availableMB for each queue should be their allowed max resource minus allocatedMB.

      Attachments

        1. YARN-1735.v1.patch
          6 kB
          Siqi Li
        2. YARN-1735.v2.patch
          7 kB
          Siqi Li
        3. YARN-1735.v3.patch
          7 kB
          Siqi Li
        4. YARN-1735.v4.patch
          7 kB
          Siqi Li

        Activity

          People

            Unassigned Unassigned
            l201514 Siqi Li
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated: