Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3026

Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Have a discussion with vinodkv and jianhe:

      In existing Capacity Scheduler, all allocation logics of and under LeafQueue are located in LeafQueue.java in implementation. To make a cleaner scope of LeafQueue, we'd better move some of them to FiCaSchedulerApp.

      Ideal scope of LeafQueue should be: when a LeafQueue receives some resources from ParentQueue (like 15% of cluster resource), and it distributes resources to children apps, and it should be agnostic to internal logic of children apps (like delayed-scheduling, etc.). IAW, LeafQueue shouldn't decide how application allocating container from given resources.

      Attachments

        1. YARN-3026.1.patch
          93 kB
          Wangda Tan
        2. YARN-3026.2.patch
          95 kB
          Wangda Tan
        3. YARN-3026.3.patch
          119 kB
          Wangda Tan
        4. YARN-3026.4.patch
          119 kB
          Wangda Tan
        5. YARN-3026.5.patch
          136 kB
          Wangda Tan
        6. YARN-3026.6.patch
          136 kB
          Wangda Tan

        Issue Links

          Activity

            People

              leftnoteasy Wangda Tan
              leftnoteasy Wangda Tan
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: