Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6867

AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • None
    • None
    • scheduler
    • None

    Description

      AbstractYarnScheduler has a configured wait time during which it reports the maximum resources from the configuration instead of the actual resources available in the cluster. However, the first query after the wait time expiration is responded by the configured maximum resources instead of the actual maximum resources. This can result in a app submission to fail with an InvalidResourceRequestException (will attach a unit test in the patch) since the maximum resources reported by the RM is different than the one it sanity checks against at app submission.

      Attachments

        1. YARN-6867.001.patch
          6 kB
          Muhammad Samir Khan

        Issue Links

          Is contained by

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4719 Add a helper library to maintain node state and allows common queries

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-56 Handle container requests that request more resources than currently available in the cluster

          • Major - Major loss of function.
          • Open

          Activity

            People

              nroberts Nathan Roberts
              samkhan Muhammad Samir Khan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: