Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10843 [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler - part II
  3. YARN-9904

Investigate how resource allocation configuration could be more consistent in CapacityScheduler

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • yarn
    • None

    Description

      It would be nice if everywhere where a capacity can be defined could be defined the same way:

      • With fixed amounts (eg 1GB memory, 8 vcores, 3 GPU)
      • With percentages
        • Percentage of all resources (eg 10% of all memory, vcore, GPU)
        • Percentage per resource type (eg 10% memory, 25% vcore, 50% GPU)

      We need to determine all configuration options where capacities can be defined, and see if it is possible to extend the configuration, or if it makes sense in that case.

      The outcome is a proposal for all the configurations which could/should be changed.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. YARN-10888 [Umbrella] New capacity modes for CS

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              shuzirra Gergely Pollák
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: