Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2492 (Clone of YARN-796) Allow for (admin) labels on nodes and resource-requests
  3. YARN-3092

Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler

VotersStop watchingWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Since we have labels on nodes, so we need to track resource usage by labels, includes

      • AM resource (to enforce max-am-resource-by-label after YARN-2637)
      • Used resource (includes AM resource usage)
      • Reserved resource
      • Pending resource
      • Headroom

      Benefits to have such a common class are:

      • Reuse lots of code in different places (Queue/App/User), better maintainability and readability.
      • Can make fine-grained locking (e.g. accessing used resource in a queue doesn't need lock a queue)

        Attachments

        1. YARN-3092.1.patch
          15 kB
          Wangda Tan
        2. YARN-3092.2.patch
          14 kB
          Wangda Tan

        Issue Links

          Activity

            People

            • Assignee:
              leftnoteasy Wangda Tan
              Reporter:
              leftnoteasy Wangda Tan

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment