Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3305

AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.6.0
    • 2.8.0, 3.0.0-alpha1
    • scheduler
    • None
    • Reviewed

    Description

      For given any ResourceRequest, CS#allocate normalizes request to minimumAllocation if requested memory is less than minimumAllocation.
      But AM-used resource is updated with actual ResourceRequest made by user. This results in AM container allocation more than Max ApplicationMaster Resource.

      This is because AM-Used is updated with actual ResourceRequest made by user while activating the applications. But during allocation of container, ResourceRequest is normalized to minimumAllocation.

      Attachments

        1. 0003-YARN-3305.patch
          7 kB
          Rohith Sharma K S
        2. 0002-YARN-3305.patch
          7 kB
          Rohith Sharma K S
        3. 0001-YARN-3305.patch
          4 kB
          Rohith Sharma K S
        4. 0001-YARN-3305.patch
          4 kB
          Rohith Sharma K S

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rohithsharma Rohith Sharma K S
            rohithsharma Rohith Sharma K S
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment