Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3769

Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We are seeing the preemption monitor preempting containers from queue A and then seeing the capacity scheduler giving them immediately back to queue A. This happens quite often and causes a lot of churn.

        Attachments

        1. YARN-3769.001.branch-2.7.patch
          8 kB
          Eric Payne
        2. YARN-3769.001.branch-2.8.patch
          7 kB
          Eric Payne
        3. YARN-3769.003.patch
          29 kB
          Eric Payne
        4. YARN-3769.004.patch
          30 kB
          Eric Payne
        5. YARN-3769.005.patch
          28 kB
          Eric Payne
        6. YARN-3769-branch-2.002.patch
          27 kB
          Eric Payne
        7. YARN-3769-branch-2.6.001.patch
          24 kB
          Eric Payne
        8. YARN-3769-branch-2.6.002.patch
          24 kB
          Eric Payne
        9. YARN-3769-branch-2.7.002.patch
          24 kB
          Eric Payne
        10. YARN-3769-branch-2.7.003.patch
          24 kB
          Eric Payne
        11. YARN-3769-branch-2.7.005.patch
          22 kB
          Eric Payne
        12. YARN-3769-branch-2.7.006.patch
          23 kB
          Eric Payne
        13. YARN-3769-branch-2.7.007.patch
          23 kB
          Eric Payne

        Issue Links

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment