Details

    • Hadoop Flags:
      Reviewed

      Description

      Currently the epoch always starts from zero. This can cause container ids to conflict for an application under Federation that spans multiple RMs concurrently. This JIRA proposes to make the RM epoch base value configurable which will allow us to avoid conflicts by setting different values for each RM.

      1. YARN-5601-YARN-2915-v1.patch
        15 kB
        Subru Krishnan
      2. YARN-5601-YARN-2915-v2.patch
        15 kB
        Subru Krishnan
      3. YARN-5601-YARN-2915-v3.patch
        15 kB
        Subru Krishnan

        Activity

        Hide
        subru Subru Krishnan added a comment -

        A simple patch that reads the base epoch value from config with updated tests to validate the same.

        Show
        subru Subru Krishnan added a comment - A simple patch that reads the base epoch value from config with updated tests to validate the same.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 21s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.
        0 mvndep 1m 0s Maven dependency ordering for branch
        +1 mvninstall 7m 19s YARN-2915 passed
        +1 compile 2m 25s YARN-2915 passed
        +1 checkstyle 0m 44s YARN-2915 passed
        +1 mvnsite 1m 13s YARN-2915 passed
        +1 mvneclipse 0m 34s YARN-2915 passed
        +1 findbugs 2m 8s YARN-2915 passed
        +1 javadoc 0m 45s YARN-2915 passed
        0 mvndep 0m 13s Maven dependency ordering for patch
        +1 mvninstall 1m 5s the patch passed
        +1 compile 2m 44s the patch passed
        +1 javac 2m 44s the patch passed
        -1 checkstyle 0m 44s hadoop-yarn-project/hadoop-yarn: The patch generated 2 new + 424 unchanged - 1 fixed = 426 total (was 425)
        +1 mvnsite 1m 4s the patch passed
        +1 mvneclipse 0m 26s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        -1 findbugs 1m 6s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
        +1 javadoc 0m 35s the patch passed
        +1 unit 0m 23s hadoop-yarn-api in the patch passed.
        +1 unit 38m 12s hadoop-yarn-server-resourcemanager in the patch passed.
        +1 asflicense 0m 18s The patch does not generate ASF License warnings.
        65m 19s



        Reason Tests
        FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
          Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore.baseEpoch; locked 80% of time Unsynchronized access at RMStateStore.java:80% of time Unsynchronized access at RMStateStore.java:[line 670]



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826260/YARN-5601-YARN-2915-v1.patch
        JIRA Issue YARN-5601
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 8adc278264bd 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision YARN-2915 / c77269d
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/12955/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
        findbugs https://builds.apache.org/job/PreCommit-YARN-Build/12955/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.html
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/12955/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/12955/console
        Powered by Apache Yetus 0.3.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 21s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 5 new or modified test files. 0 mvndep 1m 0s Maven dependency ordering for branch +1 mvninstall 7m 19s YARN-2915 passed +1 compile 2m 25s YARN-2915 passed +1 checkstyle 0m 44s YARN-2915 passed +1 mvnsite 1m 13s YARN-2915 passed +1 mvneclipse 0m 34s YARN-2915 passed +1 findbugs 2m 8s YARN-2915 passed +1 javadoc 0m 45s YARN-2915 passed 0 mvndep 0m 13s Maven dependency ordering for patch +1 mvninstall 1m 5s the patch passed +1 compile 2m 44s the patch passed +1 javac 2m 44s the patch passed -1 checkstyle 0m 44s hadoop-yarn-project/hadoop-yarn: The patch generated 2 new + 424 unchanged - 1 fixed = 426 total (was 425) +1 mvnsite 1m 4s the patch passed +1 mvneclipse 0m 26s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. -1 findbugs 1m 6s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) +1 javadoc 0m 35s the patch passed +1 unit 0m 23s hadoop-yarn-api in the patch passed. +1 unit 38m 12s hadoop-yarn-server-resourcemanager in the patch passed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 65m 19s Reason Tests FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager   Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore.baseEpoch; locked 80% of time Unsynchronized access at RMStateStore.java:80% of time Unsynchronized access at RMStateStore.java: [line 670] Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826260/YARN-5601-YARN-2915-v1.patch JIRA Issue YARN-5601 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 8adc278264bd 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision YARN-2915 / c77269d Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/12955/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/12955/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.html Test Results https://builds.apache.org/job/PreCommit-YARN-Build/12955/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/12955/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
        Hide
        jianhe Jian He added a comment -

        Subru Krishnan, could you please explain what the typical practice is to set this epoch number in a federated cluster?

        Show
        jianhe Jian He added a comment - Subru Krishnan , could you please explain what the typical practice is to set this epoch number in a federated cluster?
        Hide
        subru Subru Krishnan added a comment - - edited

        Jian He, to answer your question let me start with why we need epoch in a federated cluster:
        currently only a single RM generates containerIDs (applicationID + a sequence number) but in a federated cluster, there are multiple RMs that are concurrently generating them. So there will be conflicts if an application spans across multiple sub-clusters. To avoid this conflict, we use epoch in a federated cluster similar to how it's used in the context of work preserving restarts to prevent conflicts.

        The idea is we will set epoch number to be 0 for first sub-cluster RM, 10000 for second sub-cluster RM, 20000 for third sub-cluster RM, etc. This should be sufficient as we have 1M epochs as they are represented as a 20bit integer. With this, there will be a conflict of containerIDs only if all of the below conditions are satisfied:

        1. The RM of sub-cluster 1 is rebooted over 10000 times
        2. There is a running App the is still running (during over 10k reboots of one of the RMs)
        3. The app is run across sub-cluster 1 and sub-cluster 2
        4. The app is still holding onto containers from sub-cluster 2 issued from the first reboot of that sub-cluster
        5. The containers have Ids low enough that the newly issued containers from RM1 clash

        Makes sense?

        Show
        subru Subru Krishnan added a comment - - edited Jian He , to answer your question let me start with why we need epoch in a federated cluster: currently only a single RM generates containerIDs (applicationID + a sequence number) but in a federated cluster, there are multiple RMs that are concurrently generating them. So there will be conflicts if an application spans across multiple sub-clusters. To avoid this conflict, we use epoch in a federated cluster similar to how it's used in the context of work preserving restarts to prevent conflicts. The idea is we will set epoch number to be 0 for first sub-cluster RM, 10000 for second sub-cluster RM, 20000 for third sub-cluster RM, etc. This should be sufficient as we have 1M epochs as they are represented as a 20bit integer. With this, there will be a conflict of containerIDs only if all of the below conditions are satisfied: The RM of sub-cluster 1 is rebooted over 10000 times There is a running App the is still running (during over 10k reboots of one of the RMs) The app is run across sub-cluster 1 and sub-cluster 2 The app is still holding onto containers from sub-cluster 2 issued from the first reboot of that sub-cluster The containers have Ids low enough that the newly issued containers from RM1 clash Makes sense?
        Hide
        jianhe Jian He added a comment -

        sounds good, can you suppress the findbugs warning ?

        Show
        jianhe Jian He added a comment - sounds good, can you suppress the findbugs warning ?
        Hide
        subru Subru Krishnan added a comment -

        Adding findbug exclusion as suggested by Jian He

        Show
        subru Subru Krishnan added a comment - Adding findbug exclusion as suggested by Jian He
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.
        0 mvndep 2m 47s Maven dependency ordering for branch
        +1 mvninstall 7m 29s YARN-2915 passed
        +1 compile 2m 19s YARN-2915 passed
        +1 checkstyle 0m 45s YARN-2915 passed
        +1 mvnsite 4m 2s YARN-2915 passed
        +1 mvneclipse 0m 59s YARN-2915 passed
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn
        +1 findbugs 1m 57s YARN-2915 passed
        +1 javadoc 2m 21s YARN-2915 passed
        0 mvndep 0m 11s Maven dependency ordering for patch
        +1 mvninstall 3m 57s the patch passed
        +1 compile 2m 47s the patch passed
        +1 javac 2m 47s the patch passed
        -1 checkstyle 0m 44s hadoop-yarn-project/hadoop-yarn: The patch generated 2 new + 424 unchanged - 1 fixed = 426 total (was 425)
        +1 mvnsite 4m 42s the patch passed
        +1 mvneclipse 1m 1s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn
        -1 findbugs 1m 14s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
        +1 javadoc 2m 2s the patch passed
        -1 unit 19m 10s hadoop-yarn in the patch failed.
        +1 unit 0m 25s hadoop-yarn-api in the patch passed.
        +1 unit 33m 35s hadoop-yarn-server-resourcemanager in the patch passed.
        +1 asflicense 0m 20s The patch does not generate ASF License warnings.
        95m 7s



        Reason Tests
        FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
          Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore.baseEpoch; locked 80% of time Unsynchronized access at RMStateStore.java:80% of time Unsynchronized access at RMStateStore.java:[line 670]
          Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore.resourceManager; locked 60% of time Unsynchronized access at RMStateStore.java:60% of time Unsynchronized access at RMStateStore.java:[line 1187]
        Failed junit tests hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826699/YARN-5601-YARN-2915-v2.patch
        JIRA Issue YARN-5601
        Optional Tests asflicense findbugs xml compile javac javadoc mvninstall mvnsite unit checkstyle
        uname Linux 0baee712a296 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision YARN-2915 / c77269d
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/12998/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
        findbugs https://builds.apache.org/job/PreCommit-YARN-Build/12998/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.html
        unit https://builds.apache.org/job/PreCommit-YARN-Build/12998/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
        unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/12998/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/12998/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/12998/console
        Powered by Apache Yetus 0.3.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 5 new or modified test files. 0 mvndep 2m 47s Maven dependency ordering for branch +1 mvninstall 7m 29s YARN-2915 passed +1 compile 2m 19s YARN-2915 passed +1 checkstyle 0m 45s YARN-2915 passed +1 mvnsite 4m 2s YARN-2915 passed +1 mvneclipse 0m 59s YARN-2915 passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn +1 findbugs 1m 57s YARN-2915 passed +1 javadoc 2m 21s YARN-2915 passed 0 mvndep 0m 11s Maven dependency ordering for patch +1 mvninstall 3m 57s the patch passed +1 compile 2m 47s the patch passed +1 javac 2m 47s the patch passed -1 checkstyle 0m 44s hadoop-yarn-project/hadoop-yarn: The patch generated 2 new + 424 unchanged - 1 fixed = 426 total (was 425) +1 mvnsite 4m 42s the patch passed +1 mvneclipse 1m 1s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn -1 findbugs 1m 14s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0) +1 javadoc 2m 2s the patch passed -1 unit 19m 10s hadoop-yarn in the patch failed. +1 unit 0m 25s hadoop-yarn-api in the patch passed. +1 unit 33m 35s hadoop-yarn-server-resourcemanager in the patch passed. +1 asflicense 0m 20s The patch does not generate ASF License warnings. 95m 7s Reason Tests FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager   Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore.baseEpoch; locked 80% of time Unsynchronized access at RMStateStore.java:80% of time Unsynchronized access at RMStateStore.java: [line 670]   Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore.resourceManager; locked 60% of time Unsynchronized access at RMStateStore.java:60% of time Unsynchronized access at RMStateStore.java: [line 1187] Failed junit tests hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826699/YARN-5601-YARN-2915-v2.patch JIRA Issue YARN-5601 Optional Tests asflicense findbugs xml compile javac javadoc mvninstall mvnsite unit checkstyle uname Linux 0baee712a296 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision YARN-2915 / c77269d Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/12998/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/12998/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.html unit https://builds.apache.org/job/PreCommit-YARN-Build/12998/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/12998/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/12998/testReport/ modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/12998/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
        Hide
        subru Subru Krishnan added a comment -

        Fixing findbugs exclusion syntax

        Show
        subru Subru Krishnan added a comment - Fixing findbugs exclusion syntax
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 20s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 5 new or modified test files.
        0 mvndep 0m 10s Maven dependency ordering for branch
        +1 mvninstall 8m 5s YARN-2915 passed
        +1 compile 3m 44s YARN-2915 passed
        +1 checkstyle 0m 50s YARN-2915 passed
        +1 mvnsite 4m 54s YARN-2915 passed
        +1 mvneclipse 1m 5s YARN-2915 passed
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn
        +1 findbugs 2m 33s YARN-2915 passed
        +1 javadoc 2m 39s YARN-2915 passed
        0 mvndep 0m 11s Maven dependency ordering for patch
        +1 mvninstall 3m 54s the patch passed
        +1 compile 2m 48s the patch passed
        +1 javac 2m 48s the patch passed
        -1 checkstyle 0m 48s hadoop-yarn-project/hadoop-yarn: The patch generated 2 new + 424 unchanged - 1 fixed = 426 total (was 425)
        +1 mvnsite 4m 44s the patch passed
        +1 mvneclipse 1m 1s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 2s The patch has no ill-formed XML file.
        0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn
        +1 findbugs 2m 30s the patch passed
        +1 javadoc 2m 14s the patch passed
        -1 unit 19m 44s hadoop-yarn in the patch failed.
        +1 unit 0m 23s hadoop-yarn-api in the patch passed.
        +1 unit 33m 49s hadoop-yarn-server-resourcemanager in the patch passed.
        +1 asflicense 0m 17s The patch does not generate ASF License warnings.
        97m 37s



        Reason Tests
        Failed junit tests hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826719/YARN-5601-YARN-2915-v3.patch
        JIRA Issue YARN-5601
        Optional Tests asflicense findbugs xml compile javac javadoc mvninstall mvnsite unit checkstyle
        uname Linux 59b6f25d5038 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision YARN-2915 / bd906b2
        Default Java 1.8.0_101
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13001/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/13001/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
        unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/13001/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13001/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/13001/console
        Powered by Apache Yetus 0.3.0 http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 20s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 5 new or modified test files. 0 mvndep 0m 10s Maven dependency ordering for branch +1 mvninstall 8m 5s YARN-2915 passed +1 compile 3m 44s YARN-2915 passed +1 checkstyle 0m 50s YARN-2915 passed +1 mvnsite 4m 54s YARN-2915 passed +1 mvneclipse 1m 5s YARN-2915 passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn +1 findbugs 2m 33s YARN-2915 passed +1 javadoc 2m 39s YARN-2915 passed 0 mvndep 0m 11s Maven dependency ordering for patch +1 mvninstall 3m 54s the patch passed +1 compile 2m 48s the patch passed +1 javac 2m 48s the patch passed -1 checkstyle 0m 48s hadoop-yarn-project/hadoop-yarn: The patch generated 2 new + 424 unchanged - 1 fixed = 426 total (was 425) +1 mvnsite 4m 44s the patch passed +1 mvneclipse 1m 1s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 2s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn +1 findbugs 2m 30s the patch passed +1 javadoc 2m 14s the patch passed -1 unit 19m 44s hadoop-yarn in the patch failed. +1 unit 0m 23s hadoop-yarn-api in the patch passed. +1 unit 33m 49s hadoop-yarn-server-resourcemanager in the patch passed. +1 asflicense 0m 17s The patch does not generate ASF License warnings. 97m 37s Reason Tests Failed junit tests hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12826719/YARN-5601-YARN-2915-v3.patch JIRA Issue YARN-5601 Optional Tests asflicense findbugs xml compile javac javadoc mvninstall mvnsite unit checkstyle uname Linux 59b6f25d5038 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision YARN-2915 / bd906b2 Default Java 1.8.0_101 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/13001/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/13001/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit test logs https://builds.apache.org/job/PreCommit-YARN-Build/13001/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/13001/testReport/ modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/13001/console Powered by Apache Yetus 0.3.0 http://yetus.apache.org This message was automatically generated.
        Hide
        subru Subru Krishnan added a comment -

        The test case failure seems unrelated to the patch.

        Show
        subru Subru Krishnan added a comment - The test case failure seems unrelated to the patch.
        Hide
        jianhe Jian He added a comment -

        Committed to YARN-2915, thanks Subru !

        Show
        jianhe Jian He added a comment - Committed to YARN-2915 , thanks Subru !
        Hide
        subru Subru Krishnan added a comment -

        Thanks Jian He for reviewing/committing.

        Show
        subru Subru Krishnan added a comment - Thanks Jian He for reviewing/committing.

          People

          • Assignee:
            subru Subru Krishnan
            Reporter:
            subru Subru Krishnan
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development