Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3026

Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Have a discussion with Vinod Kumar Vavilapalli and Jian He:

      In existing Capacity Scheduler, all allocation logics of and under LeafQueue are located in LeafQueue.java in implementation. To make a cleaner scope of LeafQueue, we'd better move some of them to FiCaSchedulerApp.

      Ideal scope of LeafQueue should be: when a LeafQueue receives some resources from ParentQueue (like 15% of cluster resource), and it distributes resources to children apps, and it should be agnostic to internal logic of children apps (like delayed-scheduling, etc.). IAW, LeafQueue shouldn't decide how application allocating container from given resources.

        Attachments

        1. YARN-3026.6.patch
          136 kB
          Wangda Tan
        2. YARN-3026.5.patch
          136 kB
          Wangda Tan
        3. YARN-3026.4.patch
          119 kB
          Wangda Tan
        4. YARN-3026.3.patch
          119 kB
          Wangda Tan
        5. YARN-3026.2.patch
          95 kB
          Wangda Tan
        6. YARN-3026.1.patch
          93 kB
          Wangda Tan

          Issue Links

            Activity

              People

              • Assignee:
                leftnoteasy Wangda Tan
                Reporter:
                leftnoteasy Wangda Tan
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: