Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9326

Fair Scheduler configuration defaults are not documented in case of min and maxResources

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      The FairScheduler's configuration has the following defaults (from the code: javadoc):

      In new style resources, any resource that is not specified will be set to missing or 0%, as appropriate. Also, in the new style resources, units are not allowed. Units are assumed from the resource manager's settings for the resources when the value isn't a percentage. The missing parameter is only used in the case of new style resources without percentages. With new style resources with percentages, any missing resources will be assumed to be 100% because percentages are only used with maximum resource limits.
      

      This is not documented in the hadoop yarn site FairScheduler.html. It is quite intuitive, but still need to be documented though.

      Attachments

        1. YARN-9326.001.patch
          7 kB
          Adam Antal
        2. YARN-9326.002.patch
          7 kB
          Adam Antal
        3. YARN-9326.003.patch
          6 kB
          Adam Antal
        4. YARN-9326.004.patch
          6 kB
          Adam Antal
        5. YARN-9326.005.patch
          7 kB
          Adam Antal

        Activity

          People

            adam.antal Adam Antal
            adam.antal Adam Antal
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: