Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7291

Better input parsing for resource in allocation file

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.1.0
    • 3.3.0
    • fairscheduler
    • Reviewed

    Description

      When you set max/min share for queues in fair scheduler allocation file, "1024 mb, 2 4 vcores" is parsed the same as "1024 mb, 4 vcores" without any issue, the same to "50% memory, 50% 100%cpu" which is parsed the same as "50% memory, 100%cpu". That causes confusing. We should fix it.

      Attachments

        1. YARN-7291.001.patch
          12 kB
          Szilard Nemeth
        2. YARN-7291.002.patch
          11 kB
          Szilard Nemeth
        3. YARN-7291.003.patch
          16 kB
          Szilard Nemeth
        4. YARN-7291.004.patch
          16 kB
          Szilard Nemeth
        5. YARN-7291.005.patch
          16 kB
          Szilard Nemeth
        6. YARN-7291.005.patch
          16 kB
          Szilard Nemeth

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. YARN-8738 FairScheduler should not parse negative maxResources or minResources values as positive

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              zsiegl Zoltan Siegl
              yufeigu Yufei Gu
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: