Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3508

Prevent processing preemption events on the main RM dispatcher

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We recently saw the RM for a large cluster lag far behind on the AsyncDispacher event queue. The AsyncDispatcher thread was consistently blocked on the highly-contended CapacityScheduler lock trying to dispatch preemption-related events for RMContainerPreemptEventDispatcher. Preemption processing should occur on the scheduler event dispatcher thread or a separate thread to avoid delaying the processing of other events in the primary dispatcher queue.

      1. YARN-3508.002.patch
        14 kB
        Varun Saxena
      2. YARN-3508.01.patch
        13 kB
        Varun Saxena
      3. YARN-3508.03.patch
        26 kB
        Varun Saxena
      4. YARN-3508.04.patch
        26 kB
        Varun Saxena
      5. YARN-3508.05.patch
        33 kB
        Varun Saxena
      6. YARN-3508.06.patch
        33 kB
        Varun Saxena
      7. YARN-3508-branch-2.7.01.patch
        29 kB
        Varun Saxena

        Activity

        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 17m 43s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        -1 javac 9m 9s The applied patch generated 6 additional warning messages.
        +1 javadoc 11m 16s There were no new javadoc warning messages.
        +1 release audit 0m 30s The applied patch does not increase the total number of release audit warnings.
        -1 checkstyle 0m 55s The applied patch generated 3 new checkstyle issues (total was 53, now 55).
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 2m 12s mvn install still works.
        +1 eclipse:eclipse 0m 39s The patch built with eclipse:eclipse.
        -1 findbugs 1m 48s The patch appears to introduce 1 new Findbugs (version 3.0.0) warnings.
        +1 yarn tests 51m 54s Tests passed in hadoop-yarn-server-resourcemanager.
            96m 10s  



        Reason Tests
        FindBugs module:hadoop-yarn-server-resourcemanager



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12735991/YARN-3508.01.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 9acd24f
        javac https://builds.apache.org/job/PreCommit-YARN-Build/8120/artifact/patchprocess/diffJavacWarnings.txt
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8120/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
        Findbugs warnings https://builds.apache.org/job/PreCommit-YARN-Build/8120/artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
        hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8120/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8120/testReport/
        Java 1.7.0_55
        uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8120/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 17m 43s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. -1 javac 9m 9s The applied patch generated 6 additional warning messages. +1 javadoc 11m 16s There were no new javadoc warning messages. +1 release audit 0m 30s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 55s The applied patch generated 3 new checkstyle issues (total was 53, now 55). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 2m 12s mvn install still works. +1 eclipse:eclipse 0m 39s The patch built with eclipse:eclipse. -1 findbugs 1m 48s The patch appears to introduce 1 new Findbugs (version 3.0.0) warnings. +1 yarn tests 51m 54s Tests passed in hadoop-yarn-server-resourcemanager.     96m 10s   Reason Tests FindBugs module:hadoop-yarn-server-resourcemanager Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12735991/YARN-3508.01.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 9acd24f javac https://builds.apache.org/job/PreCommit-YARN-Build/8120/artifact/patchprocess/diffJavacWarnings.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8120/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt Findbugs warnings https://builds.apache.org/job/PreCommit-YARN-Build/8120/artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8120/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8120/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8120/console This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 16m 14s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 7m 35s There were no new javac warning messages.
        +1 javadoc 9m 35s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        -1 checkstyle 0m 50s The applied patch generated 1 new checkstyle issues (total was 53, now 53).
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 36s mvn install still works.
        +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.
        +1 findbugs 1m 27s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 yarn tests 50m 38s Tests passed in hadoop-yarn-server-resourcemanager.
            89m 2s  



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12736323/YARN-3508.02.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / eb6bf91
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8137/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
        hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8137/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8137/testReport/
        Java 1.7.0_55
        uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8137/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 14s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 35s There were no new javac warning messages. +1 javadoc 9m 35s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 50s The applied patch generated 1 new checkstyle issues (total was 53, now 53). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 36s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse. +1 findbugs 1m 27s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 yarn tests 50m 38s Tests passed in hadoop-yarn-server-resourcemanager.     89m 2s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12736323/YARN-3508.02.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / eb6bf91 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8137/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8137/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8137/testReport/ Java 1.7.0_55 uname Linux asf907.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8137/console This message was automatically generated.
        Hide
        varun_saxena Varun Saxena added a comment -

        Checkstyle is showing incorrect result it seems. There were 53 checkstyle issues, both, before and after the patch.

        Show
        varun_saxena Varun Saxena added a comment - Checkstyle is showing incorrect result it seems. There were 53 checkstyle issues, both, before and after the patch.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 15m 56s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 7m 35s There were no new javac warning messages.
        +1 javadoc 9m 36s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        -1 checkstyle 0m 46s The applied patch generated 1 new checkstyle issues (total was 53, now 53).
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 36s mvn install still works.
        +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
        +1 findbugs 1m 25s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 yarn tests 50m 24s Tests passed in hadoop-yarn-server-resourcemanager.
            88m 15s  



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12736416/YARN-3508.002.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / da05361
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8145/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
        hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8145/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8145/testReport/
        Java 1.7.0_55
        uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8145/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 15m 56s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 35s There were no new javac warning messages. +1 javadoc 9m 36s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 46s The applied patch generated 1 new checkstyle issues (total was 53, now 53). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 36s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 1m 25s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 yarn tests 50m 24s Tests passed in hadoop-yarn-server-resourcemanager.     88m 15s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12736416/YARN-3508.002.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / da05361 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8145/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8145/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8145/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8145/console This message was automatically generated.
        Hide
        leftnoteasy Wangda Tan added a comment -

        Trying to better understand this problem: I'm not sure where is bottleneck. If CapacityScheduler becomes bottleneck, move preemption events out of main RM dispatcher doesn't help. This approach only helps when main dispatcher is bottleneck.

        And a parallel thing we can do is to optimize number of preemption event. Currently, if a container sits in to-preempt list, before it is get preempted, one event will be sent to scheduler for every few seconds, we can reduce frequency of this event.

        Show
        leftnoteasy Wangda Tan added a comment - Trying to better understand this problem: I'm not sure where is bottleneck. If CapacityScheduler becomes bottleneck, move preemption events out of main RM dispatcher doesn't help. This approach only helps when main dispatcher is bottleneck. And a parallel thing we can do is to optimize number of preemption event. Currently, if a container sits in to-preempt list, before it is get preempted, one event will be sent to scheduler for every few seconds, we can reduce frequency of this event.
        Hide
        jlowe Jason Lowe added a comment -

        Yes, it's not a cure-all to move the preemption processing to the scheduler event queue when the scheduler is the bottleneck, but we do have separate event queues for a reason. If it didn't matter who was the bottleneck then we'd just have one event queue for everything, correct? The scheduler event queue is primarily blocked by the big scheduler lock, and IMHO we should dispatch events that need that lock to that queue. Doing otherwise starts to couple the two event dispatchers together and we might as well just have the one event queue to rule them all.

        Show
        jlowe Jason Lowe added a comment - Yes, it's not a cure-all to move the preemption processing to the scheduler event queue when the scheduler is the bottleneck, but we do have separate event queues for a reason. If it didn't matter who was the bottleneck then we'd just have one event queue for everything, correct? The scheduler event queue is primarily blocked by the big scheduler lock, and IMHO we should dispatch events that need that lock to that queue. Doing otherwise starts to couple the two event dispatchers together and we might as well just have the one event queue to rule them all.
        Hide
        jianhe Jian He added a comment -

        I think this make sense to move preemption events from main dispatcher to the scheduler dispatcher. Otherwise, any non-scheduler events on main dispatcher will be waiting for the preemption events to grab the scheduler lock, which is unnecessary.

        Show
        jianhe Jian He added a comment - I think this make sense to move preemption events from main dispatcher to the scheduler dispatcher. Otherwise, any non-scheduler events on main dispatcher will be waiting for the preemption events to grab the scheduler lock, which is unnecessary.
        Hide
        varun_saxena Varun Saxena added a comment -

        Just to clarify, in the implementation I have spawned a new preemption dispatcher thread instead of posting preemption events to scheduler dispatcher.
        This is because IMHO container preemption events should have priority over scheduler events. This approach though would make this one extra thread contending for scheduler lock.

        Another approach though would be to post events preemption events to scheduler dispatcher. And have a LinkedBlockingDeque for storing events instead. This way preemption events can be posted to front of queue. However, linked blocking deque uses a single lock for put and take operations whereas linked blocking queue uses 2 different locks for these 2 operations making the latter better from a performance viewpoint.

        Jason Lowe, Jian He, Wangda Tan, thoughts on the approaches mentioned above ?

        Show
        varun_saxena Varun Saxena added a comment - Just to clarify, in the implementation I have spawned a new preemption dispatcher thread instead of posting preemption events to scheduler dispatcher. This is because IMHO container preemption events should have priority over scheduler events. This approach though would make this one extra thread contending for scheduler lock. Another approach though would be to post events preemption events to scheduler dispatcher. And have a LinkedBlockingDeque for storing events instead. This way preemption events can be posted to front of queue. However, linked blocking deque uses a single lock for put and take operations whereas linked blocking queue uses 2 different locks for these 2 operations making the latter better from a performance viewpoint. Jason Lowe , Jian He , Wangda Tan , thoughts on the approaches mentioned above ?
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        The problem I see in the clubbing with scheduler events is if there is many scheduler events already in the event queue then it delays pre-emption events to trigger. As Varun Saxena said, container preemption events should be considered as higher priority than scheduler events. Having separate event disaptcher for preemptiong events would allow preemption events to participate in obtaining the lock in-earlier-stages rather then waiting for scheuduler events queue to complete. I think current patch approach make sense to me i.e having individual dispatcher thread for preemption events.

        Show
        rohithsharma Rohith Sharma K S added a comment - The problem I see in the clubbing with scheduler events is if there is many scheduler events already in the event queue then it delays pre-emption events to trigger. As Varun Saxena said, container preemption events should be considered as higher priority than scheduler events. Having separate event disaptcher for preemptiong events would allow preemption events to participate in obtaining the lock in- earlier -stages rather then waiting for scheuduler events queue to complete. I think current patch approach make sense to me i.e having individual dispatcher thread for preemption events.
        Hide
        varun_saxena Varun Saxena added a comment -

        Jason Lowe/Jian He/Wangda Tan/Rohith Sharma K S, can one of the commiters have a look at this ?

        Show
        varun_saxena Varun Saxena added a comment - Jason Lowe / Jian He / Wangda Tan / Rohith Sharma K S , can one of the commiters have a look at this ?
        Hide
        leftnoteasy Wangda Tan added a comment -

        I tent to support Jason Lowe and Jian He's suggestion, make preemption events directly goes to scheduler event queue.

        I think we cannot assume preemption events have higher priority than other events, in most cases, preemption events are just notify AM about something will happen. And manage two queues for scheduler can be complex, how to balance them, etc. To reduce complex, I suggest to only maintain one queue for scheduler until we have to.

        Show
        leftnoteasy Wangda Tan added a comment - I tent to support Jason Lowe and Jian He 's suggestion, make preemption events directly goes to scheduler event queue. I think we cannot assume preemption events have higher priority than other events, in most cases, preemption events are just notify AM about something will happen. And manage two queues for scheduler can be complex, how to balance them, etc. To reduce complex, I suggest to only maintain one queue for scheduler until we have to.
        Hide
        varun_saxena Varun Saxena added a comment -

        Wangda Tan, ok if thats the consensus, I will do so.

        Show
        varun_saxena Varun Saxena added a comment - Wangda Tan , ok if thats the consensus, I will do so.
        Hide
        vinodkv Vinod Kumar Vavilapalli added a comment -

        Moving out all non-critical / non-blocker issues that didn't make it out of 2.7.1 into 2.7.2.

        Show
        vinodkv Vinod Kumar Vavilapalli added a comment - Moving out all non-critical / non-blocker issues that didn't make it out of 2.7.1 into 2.7.2.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 19m 27s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
        +1 javac 8m 6s There were no new javac warning messages.
        +1 javadoc 10m 6s There were no new javadoc warning messages.
        +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings.
        -1 checkstyle 0m 49s The applied patch generated 7 new checkstyle issues (total was 248, now 251).
        +1 whitespace 0m 1s The patch has no lines that end in whitespace.
        +1 install 1m 37s mvn install still works.
        +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
        +1 findbugs 1m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        -1 yarn tests 46m 45s Tests failed in hadoop-yarn-server-resourcemanager.
            89m 23s  



        Reason Tests
        Failed unit tests hadoop.yarn.server.resourcemanager.TestApplicationCleanup
          hadoop.yarn.server.resourcemanager.TestWorkPreservingRMRestart



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12742567/YARN-3508.03.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 2ffd842
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8377/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
        hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8377/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8377/testReport/
        Java 1.7.0_55
        uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8377/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 19m 27s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 8m 6s There were no new javac warning messages. +1 javadoc 10m 6s There were no new javadoc warning messages. +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 49s The applied patch generated 7 new checkstyle issues (total was 248, now 251). +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 37s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 1m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 yarn tests 46m 45s Tests failed in hadoop-yarn-server-resourcemanager.     89m 23s   Reason Tests Failed unit tests hadoop.yarn.server.resourcemanager.TestApplicationCleanup   hadoop.yarn.server.resourcemanager.TestWorkPreservingRMRestart Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12742567/YARN-3508.03.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 2ffd842 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8377/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8377/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8377/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8377/console This message was automatically generated.
        Hide
        leftnoteasy Wangda Tan added a comment -

        Varun Saxena,
        It seems to me this patch doesn't work as what I expected:

        I think we PreemptionPolicy should directly send events to scheduler event dispatcher, so events won't go to rmDispatcher. What Jason Lowe/Jian He suggested should be the same.

        Now my understanding of this patch is, preemption events still go to rmDispatcher, and rmDispatcher sends events to schedulerDispatcher:

          @SuppressWarnings("unchecked")
          public void serviceInit(Configuration conf) throws Exception {
            scheduleEditPolicy.init(conf, rmContext.getDispatcher().getEventHandler(),
                (PreemptableResourceScheduler) rmContext.getScheduler());
            this.monitorInterval = scheduleEditPolicy.getMonitoringInterval();
            super.serviceInit(conf);
          }
        

        I think one solution is exposing scheduler events dispatcher to RMContext interface, so schedulerEditPolicy can use the schedulerDispatcher do initialization.

        And could you take a look at failed tests, it looks like related to the patch.

        Show
        leftnoteasy Wangda Tan added a comment - Varun Saxena , It seems to me this patch doesn't work as what I expected: I think we PreemptionPolicy should directly send events to scheduler event dispatcher, so events won't go to rmDispatcher. What Jason Lowe / Jian He suggested should be the same. Now my understanding of this patch is, preemption events still go to rmDispatcher, and rmDispatcher sends events to schedulerDispatcher: @SuppressWarnings( "unchecked" ) public void serviceInit(Configuration conf) throws Exception { scheduleEditPolicy.init(conf, rmContext.getDispatcher().getEventHandler(), (PreemptableResourceScheduler) rmContext.getScheduler()); this .monitorInterval = scheduleEditPolicy.getMonitoringInterval(); super .serviceInit(conf); } I think one solution is exposing scheduler events dispatcher to RMContext interface, so schedulerEditPolicy can use the schedulerDispatcher do initialization. And could you take a look at failed tests, it looks like related to the patch.
        Hide
        varun_saxena Varun Saxena added a comment -

        Wangda Tan, the test failures seem unrelated. Had submitted patch again. Lets see what that gives.

        Now my understanding of this patch is, preemption events still go to rmDispatcher, and rmDispatcher sends events to schedulerDispatcher.

        Yes, you are correct.

        The issue in the JIRA is that on picking up the ContainerPreempt Event from RM Dispatcher Queue, this event is processed by the RM Dispatcher thread itself(which can block this dispatcher) instead of putting it in another dispatcher queue. This was blocking the RM Dispatcher thread because it was waiting for scheduler lock. Hence other events in the queue were getting delayed.

        The current design is such that different dispatchers(based on event type) are registered to main RM Dispatcher. And RM Dispatcher then dispatches these events to appropriate registered dispatchers. Although, its an additional step(and may cost some extra processing time), I think this has been done to have a single point of contact for dispatching events across RM.

        We can open an interface for posting events directly to Scheduler Events as well. That ofcourse would be faster. But then this change should be made for all the scheduler events not only container preemption events. Thoughts ?

        Show
        varun_saxena Varun Saxena added a comment - Wangda Tan , the test failures seem unrelated. Had submitted patch again. Lets see what that gives. Now my understanding of this patch is, preemption events still go to rmDispatcher, and rmDispatcher sends events to schedulerDispatcher. Yes, you are correct. The issue in the JIRA is that on picking up the ContainerPreempt Event from RM Dispatcher Queue, this event is processed by the RM Dispatcher thread itself(which can block this dispatcher) instead of putting it in another dispatcher queue. This was blocking the RM Dispatcher thread because it was waiting for scheduler lock. Hence other events in the queue were getting delayed. The current design is such that different dispatchers(based on event type) are registered to main RM Dispatcher. And RM Dispatcher then dispatches these events to appropriate registered dispatchers. Although, its an additional step(and may cost some extra processing time), I think this has been done to have a single point of contact for dispatching events across RM. We can open an interface for posting events directly to Scheduler Events as well. That ofcourse would be faster. But then this change should be made for all the scheduler events not only container preemption events. Thoughts ?
        Hide
        varun_saxena Varun Saxena added a comment -

        I mean,
        We can open an interface for posting events directly to Scheduler Dispatcher as well.

        Show
        varun_saxena Varun Saxena added a comment - I mean, We can open an interface for posting events directly to Scheduler Dispatcher as well.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 16m 41s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
        +1 javac 7m 52s There were no new javac warning messages.
        +1 javadoc 10m 4s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        -1 checkstyle 0m 48s The applied patch generated 6 new checkstyle issues (total was 248, now 250).
        +1 whitespace 0m 1s The patch has no lines that end in whitespace.
        +1 install 1m 34s mvn install still works.
        +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse.
        +1 findbugs 1m 27s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        -1 yarn tests 50m 58s Tests failed in hadoop-yarn-server-resourcemanager.
            90m 28s  



        Reason Tests
        Timed out tests org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestQueueManager



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12742603/YARN-3508.04.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 8e33372
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8378/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
        hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8378/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8378/testReport/
        Java 1.7.0_55
        uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8378/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 41s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 7m 52s There were no new javac warning messages. +1 javadoc 10m 4s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 48s The applied patch generated 6 new checkstyle issues (total was 248, now 250). +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 34s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse. +1 findbugs 1m 27s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 yarn tests 50m 58s Tests failed in hadoop-yarn-server-resourcemanager.     90m 28s   Reason Tests Timed out tests org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestQueueManager Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12742603/YARN-3508.04.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 8e33372 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8378/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8378/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8378/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8378/console This message was automatically generated.
        Hide
        leftnoteasy Wangda Tan added a comment -

        Thanks for explanation, Varun Saxena.

        Currently, YARN's non-preemption scheduler events are sent to central RM dispatcher and then pushed to scheduler event queue. RM dispatcher won't wait for these events to be handled, so the performance should be good.

        Preemption event is different, RMContainerPreemptEventDispatcher is a synchronized dispatcher, when RMDispatcher receive these events, it will wait for these events proceeded.

        My suggestion is to make ContainerPreemptEventType as a part of SchedulerEventType, and ProportionalCapacityPreemptionPolicy sends the event to RMDispatcher. So these events will be sent to SchedulerEventQueue, and not block central RMDispatcher.

        Thoughts?

        Show
        leftnoteasy Wangda Tan added a comment - Thanks for explanation, Varun Saxena . Currently, YARN's non-preemption scheduler events are sent to central RM dispatcher and then pushed to scheduler event queue. RM dispatcher won't wait for these events to be handled, so the performance should be good. Preemption event is different, RMContainerPreemptEventDispatcher is a synchronized dispatcher, when RMDispatcher receive these events, it will wait for these events proceeded. My suggestion is to make ContainerPreemptEventType as a part of SchedulerEventType , and ProportionalCapacityPreemptionPolicy sends the event to RMDispatcher . So these events will be sent to SchedulerEventQueue, and not block central RMDispatcher. Thoughts?
        Hide
        varun_saxena Varun Saxena added a comment -

        Wangda Tan, yes this is what the patch does and addresses the issue in hand. I thought you want me to put events directly to Scheduler Event Queue and hence bypass Central RM Dispatcher Queue.

        Anyways just to explain, below is what I have done.
        I have removed ContainerPreemptEventType and moved all these events to SchedulerEventType.
        I have also removed RMContainerPreemptEventDispatcher because that processes the events synchronously as part of RMDispatcher Event Thread.

        As per patch the events from ProportionalCapacityPreemptionPolicy are sent to central RM Dispatcher and as the event type is SchedulerEventType, the preemption events are sent to scheduler event queue.
        Then the Scheduler Dispatcher picks up these events from scheduler event queue and call CapacityScheduler#handle which then calls the relevant method to handle different preemption events.

        I added a test case too for this behavior by adding a new test class TestRMDispatcher.

        Show
        varun_saxena Varun Saxena added a comment - Wangda Tan , yes this is what the patch does and addresses the issue in hand. I thought you want me to put events directly to Scheduler Event Queue and hence bypass Central RM Dispatcher Queue. Anyways just to explain, below is what I have done. I have removed ContainerPreemptEventType and moved all these events to SchedulerEventType . I have also removed RMContainerPreemptEventDispatcher because that processes the events synchronously as part of RMDispatcher Event Thread. As per patch the events from ProportionalCapacityPreemptionPolicy are sent to central RM Dispatcher and as the event type is SchedulerEventType , the preemption events are sent to scheduler event queue. Then the Scheduler Dispatcher picks up these events from scheduler event queue and call CapacityScheduler#handle which then calls the relevant method to handle different preemption events. I added a test case too for this behavior by adding a new test class TestRMDispatcher .
        Hide
        leftnoteasy Wangda Tan added a comment -

        I think my comment confusing you: https://issues.apache.org/jira/browse/YARN-3508?focusedCommentId=14606576&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14606576. I was thinking yesterday that we need to directly send preemption events to scheduler event dispatcher. But if we expose scheduler event dispatcher in RMContext, more event dispatcher will be exposed in the future, that is against the reason why we have a central RM dispatcher.

        You patch basically looks good, some minor comments:

        • Instead of passing EventHandler<SchedulerEvent> to Proportional.., you should pass RMContext.
        • Not caused by your patch, save e.getKey() to ApplicationAttemptId in containerBasedPreemptOrKill avoid multiple getKey
        • Source: ProportionalCapacityPreemptionPolicy, should be SchedulingEditPolicy

        Other looks good to me.

        Show
        leftnoteasy Wangda Tan added a comment - I think my comment confusing you: https://issues.apache.org/jira/browse/YARN-3508?focusedCommentId=14606576&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14606576 . I was thinking yesterday that we need to directly send preemption events to scheduler event dispatcher. But if we expose scheduler event dispatcher in RMContext, more event dispatcher will be exposed in the future, that is against the reason why we have a central RM dispatcher. You patch basically looks good, some minor comments: Instead of passing EventHandler<SchedulerEvent> to Proportional.., you should pass RMContext. Not caused by your patch, save e.getKey() to ApplicationAttemptId in containerBasedPreemptOrKill avoid multiple getKey Source: ProportionalCapacityPreemptionPolicy, should be SchedulingEditPolicy Other looks good to me.
        Hide
        varun_saxena Varun Saxena added a comment -

        Instead of passing EventHandler<SchedulerEvent> to Proportional.., you should pass RMContext.

        Ok, IIUC you want me to pass RMContext to ProportionalCapacityPreemptionPolicy and get event handler from there. Correct ?

        Show
        varun_saxena Varun Saxena added a comment - Instead of passing EventHandler<SchedulerEvent> to Proportional.., you should pass RMContext. Ok, IIUC you want me to pass RMContext to ProportionalCapacityPreemptionPolicy and get event handler from there. Correct ?
        Hide
        varun_saxena Varun Saxena added a comment -

        Any reason you want this changed ? Even if we pass RMContext we will have to eventually get EventHandler from that because SchedulingEditPolicy#init wants that. And anyways ProportionalCapacityPreemptionPolicy constructors are used only from tests.

        Show
        varun_saxena Varun Saxena added a comment - Any reason you want this changed ? Even if we pass RMContext we will have to eventually get EventHandler from that because SchedulingEditPolicy#init wants that. And anyways ProportionalCapacityPreemptionPolicy constructors are used only from tests.
        Hide
        leftnoteasy Wangda Tan added a comment -

        Ok, IIUC you want me to pass RMContext to ProportionalCapacityPreemptionPolicy and get event handler from there. Correct ?

        Yes

        Any reason you want this changed?

        RM components have a reference to RMContext is a convention, you can see most of RM components have RMContext. And this can avoid some future code changes if Proportional..Policy needs more information beyond dispatcher.

        And anyways ProportionalCapacityPreemptionPolicy constructors are used only from tests.

        Init is used by production code, I suggest to make constructor/init signature consistent.

        Show
        leftnoteasy Wangda Tan added a comment - Ok, IIUC you want me to pass RMContext to ProportionalCapacityPreemptionPolicy and get event handler from there. Correct ? Yes Any reason you want this changed? RM components have a reference to RMContext is a convention, you can see most of RM components have RMContext. And this can avoid some future code changes if Proportional..Policy needs more information beyond dispatcher. And anyways ProportionalCapacityPreemptionPolicy constructors are used only from tests. Init is used by production code, I suggest to make constructor/init signature consistent.
        Hide
        varun_saxena Varun Saxena added a comment -

        Wangda Tan,

        Init is used by production code, I suggest to make constructor/init signature consistent.

        Yes SchedulingEditPolicy#init and constructor are consistent. init takes EventHandler as argument just like the constructor. Anyways I will make the change.
        I will therefore, change SchedulingEditPolicy#init as well (to make it consistent with the constructor).

        By the way, this is how SchdulingEditPolicy#init looked before my change.

          public void init(Configuration config, EventHandler<ContainerPreemptEvent> dispatcher, PreemptableResourceScheduler scheduler);
        

        And this is how ProportionalCapacityPreemptionPolicy constructor looked.

           public ProportionalCapacityPreemptionPolicy(Configuration config, EventHandler<ContainerPreemptEvent> dispatcher, CapacityScheduler scheduler)
        

        So I merely changed EventHandler<ContainerPreemptEvent> to EventHandler<SchedulerEvent> in the function signature.

        Will make the change and update patch shortly.

        Show
        varun_saxena Varun Saxena added a comment - Wangda Tan , Init is used by production code, I suggest to make constructor/init signature consistent. Yes SchedulingEditPolicy#init and constructor are consistent. init takes EventHandler as argument just like the constructor. Anyways I will make the change. I will therefore, change SchedulingEditPolicy#init as well (to make it consistent with the constructor). By the way, this is how SchdulingEditPolicy#init looked before my change. public void init(Configuration config, EventHandler<ContainerPreemptEvent> dispatcher, PreemptableResourceScheduler scheduler); And this is how ProportionalCapacityPreemptionPolicy constructor looked. public ProportionalCapacityPreemptionPolicy(Configuration config, EventHandler<ContainerPreemptEvent> dispatcher, CapacityScheduler scheduler) So I merely changed EventHandler<ContainerPreemptEvent> to EventHandler<SchedulerEvent> in the function signature. Will make the change and update patch shortly.
        Hide
        varun_saxena Varun Saxena added a comment -

        Wangda Tan, updated the patch as per your comments. Kindly review.

        Show
        varun_saxena Varun Saxena added a comment - Wangda Tan , updated the patch as per your comments. Kindly review.
        Hide
        varun_saxena Varun Saxena added a comment -

        BTW, as we are passing RMContext into SchedulingEditPolicy#init, we can do away with PreemptableResourceScheduler as its parameter as well because we can get scheduler instance from RMContext as well.

        Show
        varun_saxena Varun Saxena added a comment - BTW, as we are passing RMContext into SchedulingEditPolicy#init , we can do away with PreemptableResourceScheduler as its parameter as well because we can get scheduler instance from RMContext as well.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 23m 5s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
        +1 javac 9m 59s There were no new javac warning messages.
        +1 javadoc 11m 10s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        -1 checkstyle 0m 51s The applied patch generated 7 new checkstyle issues (total was 249, now 251).
        +1 whitespace 0m 2s The patch has no lines that end in whitespace.
        +1 install 1m 34s mvn install still works.
        +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
        +1 findbugs 1m 28s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        -1 yarn tests 48m 28s Tests failed in hadoop-yarn-server-resourcemanager.
            97m 39s  



        Reason Tests
        Failed unit tests hadoop.yarn.server.resourcemanager.scheduler.fifo.TestFifoScheduler
          hadoop.yarn.server.resourcemanager.TestRM
        Timed out tests org.apache.hadoop.yarn.server.resourcemanager.TestWorkPreservingRMRestart



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12742937/YARN-3508.05.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 147e020
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8397/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
        hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8397/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8397/testReport/
        Java 1.7.0_55
        uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8397/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 23m 5s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 9m 59s There were no new javac warning messages. +1 javadoc 11m 10s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 51s The applied patch generated 7 new checkstyle issues (total was 249, now 251). +1 whitespace 0m 2s The patch has no lines that end in whitespace. +1 install 1m 34s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 1m 28s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 yarn tests 48m 28s Tests failed in hadoop-yarn-server-resourcemanager.     97m 39s   Reason Tests Failed unit tests hadoop.yarn.server.resourcemanager.scheduler.fifo.TestFifoScheduler   hadoop.yarn.server.resourcemanager.TestRM Timed out tests org.apache.hadoop.yarn.server.resourcemanager.TestWorkPreservingRMRestart Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12742937/YARN-3508.05.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 147e020 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8397/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8397/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8397/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8397/console This message was automatically generated.
        Hide
        varun_saxena Varun Saxena added a comment -

        Fixed one checkstyle issue

        Show
        varun_saxena Varun Saxena added a comment - Fixed one checkstyle issue
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 16m 28s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 3 new or modified test files.
        +1 javac 7m 57s There were no new javac warning messages.
        +1 javadoc 9m 45s There were no new javadoc warning messages.
        +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
        -1 checkstyle 0m 49s The applied patch generated 6 new checkstyle issues (total was 249, now 250).
        +1 whitespace 0m 2s The patch has no lines that end in whitespace.
        +1 install 1m 33s mvn install still works.
        +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
        +1 findbugs 1m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        -1 yarn tests 61m 26s Tests failed in hadoop-yarn-server-resourcemanager.
            100m 29s  



        Reason Tests
        Timed out tests org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12742972/YARN-3508.06.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / d0cc038
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8399/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt
        hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8399/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8399/testReport/
        Java 1.7.0_55
        uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/8399/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 28s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 3 new or modified test files. +1 javac 7m 57s There were no new javac warning messages. +1 javadoc 9m 45s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 0m 49s The applied patch generated 6 new checkstyle issues (total was 249, now 250). +1 whitespace 0m 2s The patch has no lines that end in whitespace. +1 install 1m 33s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 1m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings. -1 yarn tests 61m 26s Tests failed in hadoop-yarn-server-resourcemanager.     100m 29s   Reason Tests Timed out tests org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12742972/YARN-3508.06.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / d0cc038 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/8399/artifact/patchprocess/diffcheckstylehadoop-yarn-server-resourcemanager.txt hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/8399/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/8399/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/8399/console This message was automatically generated.
        Hide
        varun_saxena Varun Saxena added a comment -

        Wangda Tan, the checkstyle issue is because of the formatting of following piece of code.

         switch(event.getType()) {
            case NODE_ADDED:
            {
              NodeAddedSchedulerEvent nodeAddedEvent = (NodeAddedSchedulerEvent)event;
              addNode(nodeAddedEvent.getAddedRMNode());
              recoverContainersOnNode(nodeAddedEvent.getContainerReports(),
                nodeAddedEvent.getAddedRMNode());
            }
            break;
            case NODE_REMOVED:
            {
              NodeRemovedSchedulerEvent nodeRemovedEvent = (NodeRemovedSchedulerEvent)event;
              removeNode(nodeRemovedEvent.getRemovedRMNode());
            }
            break;
        

        I added the code in the same format as previous piece of code. If I fix this issue I will have to change code unrelated to my change as well.
        Do you want me to fix it ? Or ignore this checkstyle issue ?

        Show
        varun_saxena Varun Saxena added a comment - Wangda Tan , the checkstyle issue is because of the formatting of following piece of code. switch (event.getType()) { case NODE_ADDED: { NodeAddedSchedulerEvent nodeAddedEvent = (NodeAddedSchedulerEvent)event; addNode(nodeAddedEvent.getAddedRMNode()); recoverContainersOnNode(nodeAddedEvent.getContainerReports(), nodeAddedEvent.getAddedRMNode()); } break ; case NODE_REMOVED: { NodeRemovedSchedulerEvent nodeRemovedEvent = (NodeRemovedSchedulerEvent)event; removeNode(nodeRemovedEvent.getRemovedRMNode()); } break ; I added the code in the same format as previous piece of code. If I fix this issue I will have to change code unrelated to my change as well. Do you want me to fix it ? Or ignore this checkstyle issue ?
        Hide
        varun_saxena Varun Saxena added a comment -

        Wangda Tan, the timed out test TestNodeLabelContainerAllocation is unrelated and will be handled by YARN-3848.
        Maybe you can review that JIRA too

        Show
        varun_saxena Varun Saxena added a comment - Wangda Tan , the timed out test TestNodeLabelContainerAllocation is unrelated and will be handled by YARN-3848 . Maybe you can review that JIRA too
        Hide
        leftnoteasy Wangda Tan added a comment -

        Thanks for update, Varun Saxena.

        Checkstyle is fine to me, the patch generally looks good. Jian He/Jason Lowe, could you take a look also?

        Show
        leftnoteasy Wangda Tan added a comment - Thanks for update, Varun Saxena . Checkstyle is fine to me, the patch generally looks good. Jian He / Jason Lowe , could you take a look also?
        Hide
        jianhe Jian He added a comment -

        lgtm, thanks Varun Saxena !

        Show
        jianhe Jian He added a comment - lgtm, thanks Varun Saxena !
        Hide
        leftnoteasy Wangda Tan added a comment -

        Committing..

        Show
        leftnoteasy Wangda Tan added a comment - Committing..
        Hide
        leftnoteasy Wangda Tan added a comment -

        Varun Saxena,

        I just pushed this change to trunk/branch-2. Could you rebase the patch to branch-2.7 and run tests of RM? I will resolve the patch after it went to branch-2.7.

        Thanks,
        Wangda

        Show
        leftnoteasy Wangda Tan added a comment - Varun Saxena , I just pushed this change to trunk/branch-2. Could you rebase the patch to branch-2.7 and run tests of RM? I will resolve the patch after it went to branch-2.7. Thanks, Wangda
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #8109 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8109/)
        YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8109 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8109/ ) YARN-3508 . Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java
        Hide
        varun_saxena Varun Saxena added a comment -

        Thanks for the review and commit Wangda Tan. Will make the changes for 2.7 and update

        Show
        varun_saxena Varun Saxena added a comment - Thanks for the review and commit Wangda Tan . Will make the changes for 2.7 and update
        Hide
        varun_saxena Varun Saxena added a comment -

        Thanks for the review Jian He

        Show
        varun_saxena Varun Saxena added a comment - Thanks for the review Jian He
        Hide
        varun_saxena Varun Saxena added a comment -

        Wangda Tan, updated patch for branch-2.7

        Show
        varun_saxena Varun Saxena added a comment - Wangda Tan , updated patch for branch-2.7
        Hide
        leftnoteasy Wangda Tan added a comment -

        Committed to trunk/branch-2/branch-2.7, thanks Varun Saxena and review from Rohith Sharma K S, Jian He, Jason Lowe.

        Show
        leftnoteasy Wangda Tan added a comment - Committed to trunk/branch-2/branch-2.7, thanks Varun Saxena and review from Rohith Sharma K S , Jian He , Jason Lowe .
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #246 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/246/)
        YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #246 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/246/ ) YARN-3508 . Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk #976 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/976/)
        YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #976 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/976/ ) YARN-3508 . Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #244 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/244/)
        YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #244 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/244/ ) YARN-3508 . Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #234 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/234/)
        YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #234 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/234/ ) YARN-3508 . Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Hdfs-trunk #2173 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2173/)
        YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java
        • hadoop-yarn-project/CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk #2173 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2173/ ) YARN-3508 . Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java hadoop-yarn-project/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #2192 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2192/)
        YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)

        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/CHANGES.txt
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java
        • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2192 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2192/ ) YARN-3508 . Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) (wangda: rev 0e4b06690ff51fbde3ab26f68fde8aeb32af69af) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingMonitor.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMDispatcher.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/ProportionalCapacityPreemptionPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/SchedulingEditPolicy.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/ContainerPreemptEvent.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/monitor/capacity/TestProportionalCapacityPreemptionPolicyForNodePartitions.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java

          People

          • Assignee:
            varun_saxena Varun Saxena
            Reporter:
            jlowe Jason Lowe
          • Votes:
            0 Vote for this issue
            Watchers:
            19 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development