Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9326

Fair Scheduler configuration defaults are not documented in case of min and maxResources

    XMLWordPrintableJSON

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The FairScheduler's configuration has the following defaults (from the code: javadoc):

      In new style resources, any resource that is not specified will be set to missing or 0%, as appropriate. Also, in the new style resources, units are not allowed. Units are assumed from the resource manager's settings for the resources when the value isn't a percentage. The missing parameter is only used in the case of new style resources without percentages. With new style resources with percentages, any missing resources will be assumed to be 100% because percentages are only used with maximum resource limits.
      

      This is not documented in the hadoop yarn site FairScheduler.html. It is quite intuitive, but still need to be documented though.

        Attachments

        1. YARN-9326.001.patch
          7 kB
          Adam Antal
        2. YARN-9326.002.patch
          7 kB
          Adam Antal
        3. YARN-9326.003.patch
          6 kB
          Adam Antal
        4. YARN-9326.004.patch
          6 kB
          Adam Antal
        5. YARN-9326.005.patch
          7 kB
          Adam Antal

          Activity

            People

            • Assignee:
              adam.antal Adam Antal
              Reporter:
              adam.antal Adam Antal
            • Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: