Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-656 In scheduler UI, including reserved memory in "Memory Total" can make it exceed cluster capacity.
  3. YARN-1415

In scheduler UI, including used memory in "Memory Total" seems to be inaccurate

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • None
    • None
    • resourcemanager, scheduler
    • None

    Description

      "Memory Total" is currently a sum of availableMB, allocatedMB, and reservedMB.

      It seems that the term "availableMB" actually means "total memory", since it doesn't get decreased when some jobs use a certain amount of memory.

      Hence, the Memory Total should not include allocatedMB, or availableMB doesn't get updated properly.

      Attachments

        1. 1.png
          22 kB
          Siqi Li
        2. 2.png
          31 kB
          Siqi Li

        Activity

          People

            Unassigned Unassigned
            l201514 Siqi Li
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: