Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9314

Fair Scheduler: Queue Info mistake when configured same queue name at same level

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 3.1.0
    • None
    • None
    • None

    Description

      The Queue Info is configured in fair-scheduler.xml like below

      <queue name="root">
           <queue name="deva">
               <minResources>3072mb,3vcores</minResources>
              <maxResources>4096mb,4vcores</maxResources>
               <queue name="sample">
                    <minResources>1024mb,1vcores</minResources>
                   <maxResources>2048mb,2vcores</maxResources>
                    <aclSubmitApps>Charlie</aclSubmitApps>
                </queue>
            </queue>
           <queue name="deva">
                <minResources>1024mb,1vcores</minResources>
                <maxResources>2048mb,2vcores</maxResources>
            </queue>
      </allocations>

      The Queue root.deva configured last will override existing root.deva in root.deva.sample, like the attachment 

       root.deva

      Used Resources: <memory:0, vCores:0>
      Min Resources: <memory:1024, vCores:1>.  => should be <3072mb,3vcores>
      Max Resources: <memory:2048, vCores:2>.  => should be <4096mb,4vcores>
      Reserved Resources: <memory:0, vCores:0>
      Steady Fair Share: <memory:1024, vCores:2>
      Instantaneous Fair Share: <memory:0, vCores:0>

       
      root.deva.sample

      Min Resources: <memory:1024, vCores:1>
      Max Resources: <memory:2048, vCores:2>
      Reserved Resources: <memory:0, vCores:0>
      Steady Fair Share: <memory:1024, vCores:2>

           

       

      Attachments

        1. Fair Scheduler Mistake when configured same queue at same level.png
          152 kB
          Yongshe Feng
        2. YARN-9341.patch
          5 kB
          Yongshe Feng
        3. YARN-9314_2.patch
          5 kB
          Shen Yinjie
        4. YARN-9314_3.patch
          5 kB
          Shen Yinjie

        Issue Links

          Activity

            People

              shenyinjie Shen Yinjie
              fengyongshe Yongshe Feng
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: