Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8743

capacity scheduler doesn't set node label to reserved container

    XMLWordPrintableJSON

    Details

      Description

      capacity scheduler doesn't set node label when new a reserved container's RMContainerImpl. When allocate this container, leafQueue will treat it as a ignorePartitionExclusivityRMContainer.

      It will cause preempt failure. When preempt happens, the preemption policy will try to preempt the reserved container while leafQueue doesn't remove it from ignorePartitionExclusivityRMContainers. In our cluster, we found that preemption policy will always try to preempt the reserved container and actually preempt nothing.

      We set the node label information to  reserved container's RMContainerImpl and redo our test. The preemption performs as expected.

        Attachments

        1. YARN-8743.001.patch
          4 kB
          Hu Ziqian
        2. YARN-8743.002.patch
          4 kB
          Hu Ziqian

          Activity

            People

            • Assignee:
              ziqian hu Hu Ziqian
              Reporter:
              ziqian hu Hu Ziqian
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: