Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-407

The requested AM memory is not checked against the maximum resource capacity in ResourceMgrDelegate and MRAppMaster

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      For the MR jobs, the requested AM memory is at the risk of being larger than the maximum resource capacity. It is because the logic to check the requested AM memory against the maximum resource capacity is missing in ResourceMgrDelegate and MRAppMaster. In contrast, this logic exists in Client and ApplicationMaster of the distributed shell.

      Another potential risk is that the requested AM memory is likely to be rounded up when being normalized, therefore the after-normalization AM memory can be larger than the maximum resource capacity as well.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zjshen Zhijie Shen
                Reporter:
                zjshen Zhijie Shen
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: