Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3926

[Umbrella] Extend the YARN resource model for easier resource-type management and profiles

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1.0
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently, there are efforts to add support for various resource-types such as disk(YARN-2139), network(YARN-2140), and HDFS bandwidth(YARN-2681). These efforts all aim to add support for a new resource type and are fairly involved efforts. In addition, once support is added, it becomes harder for users to specify the resources they need. All existing jobs have to be modified, or have to use the minimum allocation.

      This ticket is a proposal to extend the YARN resource model to a more flexible model which makes it easier to support additional resource-types. It also considers the related aspect of “resource profiles” which allow users to easily specify the various resources they need for any given container.

      This feature is already merged to trunk, please go to YARN-7069 for all pending items.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vvasudev Varun Vasudev
                Reporter:
                vvasudev Varun Vasudev
              • Votes:
                1 Vote for this issue
                Watchers:
                72 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: