Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: yarn-native-services
    • Component/s: None
    • Labels:
      None

      Description

      There are some new features like rich placement scheduling, container auto restart, container upgrade in YARN core that can be taken advantage by the native-service framework. Besides, there are quite a lot legacy code which are no longer required.
      So we decide to rewrite the core part to have a leaner codebase and make use of various advanced features in YARN.
      And the new code design will be in align with what we have designed for the service API YARN-4793

      1. YARN-6903.yarn-native-services.01.patch
        548 kB
        Jian He
      2. YARN-6903.yarn-native-services.02.patch
        567 kB
        Jian He
      3. YARN-6903.yarn-native-services.03.patch
        567 kB
        Jian He
      4. YARN-6903.yarn-native-services.04.patch
        569 kB
        Jian He
      5. YARN-6903.yarn-native-services.05.patch
        575 kB
        Jian He
      6. YARN-6903.yarn-native-services.06.patch
        577 kB
        Jian He
      7. YARN-6903.yarn-native-services.07.patch
        711 kB
        Jian He
      8. YARN-6903.yarn-native-services.08.patch
        720 kB
        Jian He

        Issue Links

          Activity

          Hide
          jianhe Jian He added a comment -

          Upload a patch with some initial offline reviews from Billie Rinaldi. thanks Billie Rinaldi !

          All the new code are put into a new package called "org.apache.hadoop.yarn.service", below are the main classes:
          1. ServiceMaster - The usual AppMaster to start all the services
          2. ServiceClient - The client to interact with ServiceMaster
          3. ServiceCLI- the CLI for interacting with yarn-native-services.
          4. ServiceScheduler - A CompositeService that mostly implements the AMRMClient and NMClient listener
          5. Component- manages a component’s lifecycle
          6. ComponentInstance - manages a component instances’s lifecycle
          7. ClientAMService - serves client requests such as flex components and get status
          8. ServiceMonitor - Does readiness checks and dependency start order triggering.
          9.ContainerFailureTracker - tracks the node failures and does blacklist accordingly
          10. TestYarnNativeServices - a fully end-to-end UT using MiniYarnCluster and an in-jvm ZK

          Show
          jianhe Jian He added a comment - Upload a patch with some initial offline reviews from Billie Rinaldi . thanks Billie Rinaldi ! All the new code are put into a new package called "org.apache.hadoop.yarn.service", below are the main classes: 1. ServiceMaster - The usual AppMaster to start all the services 2. ServiceClient - The client to interact with ServiceMaster 3. ServiceCLI - the CLI for interacting with yarn-native-services. 4. ServiceScheduler - A CompositeService that mostly implements the AMRMClient and NMClient listener 5. Component - manages a component’s lifecycle 6. ComponentInstance - manages a component instances’s lifecycle 7. ClientAMService - serves client requests such as flex components and get status 8. ServiceMonitor - Does readiness checks and dependency start order triggering. 9. ContainerFailureTracker - tracks the node failures and does blacklist accordingly 10. TestYarnNativeServices - a fully end-to-end UT using MiniYarnCluster and an in-jvm ZK
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 23s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 58 new or modified test files.
                yarn-native-services Compile Tests
          0 mvndep 3m 6s Maven dependency ordering for branch
          +1 mvninstall 15m 55s yarn-native-services passed
          +1 compile 9m 46s yarn-native-services passed
          +1 checkstyle 1m 31s yarn-native-services passed
          +1 mvnsite 6m 10s yarn-native-services passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn
          +1 findbugs 4m 27s yarn-native-services passed
          +1 javadoc 3m 44s yarn-native-services passed
                Patch Compile Tests
          0 mvndep 0m 13s Maven dependency ordering for patch
          +1 mvninstall 5m 39s the patch passed
          +1 compile 6m 19s the patch passed
          +1 cc 6m 19s the patch passed
          -1 javac 6m 19s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138)
          -0 checkstyle 1m 26s hadoop-yarn-project/hadoop-yarn: The patch generated 517 new + 1360 unchanged - 398 fixed = 1877 total (was 1758)
          +1 mvnsite 6m 54s the patch passed
          +1 shellcheck 0m 22s There were no new shellcheck issues.
          +1 shelldocs 0m 11s There were no new shelldocs issues.
          -1 whitespace 0m 0s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
          -1 whitespace 0m 1s The patch 1 line(s) with tabs.
          +1 xml 0m 3s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn
          -1 findbugs 1m 6s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 30 new + 0 unchanged - 0 fixed = 30 total (was 0)
          -1 javadoc 1m 44s hadoop-yarn in the patch failed.
          -1 javadoc 0m 20s hadoop-yarn-slider-core in the patch failed.
                Other Tests
          -1 unit 6m 0s hadoop-yarn in the patch failed.
          -1 unit 2m 37s hadoop-yarn-common in the patch failed.
          +1 unit 1m 9s hadoop-yarn-registry in the patch passed.
          -1 unit 47m 1s hadoop-yarn-server-resourcemanager in the patch failed.
          -1 unit 37m 6s hadoop-yarn-client in the patch failed.
          -1 unit 18m 54s hadoop-yarn-slider-core in the patch failed.
          +1 unit 0m 33s hadoop-yarn-services-api in the patch passed.
          -1 asflicense 0m 52s The patch generated 2 ASF License warnings.
          199m 13s



          Reason Tests
          FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core
            org.apache.hadoop.yarn.proto.ClientAMProtocol$ComponentCountProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java:[line 833]
            Class org.apache.hadoop.yarn.proto.ClientAMProtocol$ComponentCountProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java
            Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$ComponentCountProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java:[line 1101]
            org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsRequestProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java:[line 125]
            Class org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsRequestProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java
            org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsResponseProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java:[line 1396]
            Class org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsResponseProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java
            Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsResponseProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java:[line 1570]
            org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusRequestProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java:[line 1734]
            Class org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusRequestProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java
            Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusRequestProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java:[line 1908]
            org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusResponseProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java:[line 2093]
            Class org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusResponseProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java
            Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusResponseProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java:[line 2328]
            org.apache.hadoop.yarn.proto.ClientAMProtocol$StopRequestProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java:[line 2581]
            Class org.apache.hadoop.yarn.proto.ClientAMProtocol$StopRequestProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java
            Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$StopRequestProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java:[line 2755]
            org.apache.hadoop.yarn.proto.ClientAMProtocol$StopResponseProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java:[line 2919]
            Class org.apache.hadoop.yarn.proto.ClientAMProtocol$StopResponseProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java
            Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$StopResponseProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java:[line 3093]
            Switch statement found in org.apache.hadoop.yarn.service.client.ServiceCLI.exec(ClientArgs) where default case is missing At ServiceCLI.java:where default case is missing At ServiceCLI.java:[lines 40-71]
            Boxing/unboxing to parse a primitive org.apache.hadoop.yarn.service.client.ServiceClient.parseNumberOfContainers(Component, String) At ServiceClient.java:org.apache.hadoop.yarn.service.client.ServiceClient.parseNumberOfContainers(Component, String) At ServiceClient.java:[line 237]
            org.apache.hadoop.yarn.service.compinstance.ComponentInstance defines compareTo(ComponentInstance) and uses Object.equals() At ComponentInstance.java:Object.equals() At ComponentInstance.java:[lines 465-471]
            Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:[line 107]
            Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:[line 81]
            Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:[line 1966]
            Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:[line 1226]
            Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:[line 1194]
            Boxing/unboxing to parse a primitive org.apache.slider.util.ServiceApiUtil.validateCompResourceSize(Resource, Application) At ServiceApiUtil.java:org.apache.slider.util.ServiceApiUtil.validateCompResourceSize(Resource, Application) At ServiceApiUtil.java:[line 354]
            org.apache.slider.util.ServiceApiUtil.jsonSerDeser isn't final and can't be protected from malicious code At ServiceApiUtil.java:be protected from malicious code At ServiceApiUtil.java:[line 56]
          Failed junit tests hadoop.yarn.service.conf.TestLoadExampleAppJson
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            hadoop.yarn.service.client.TestServiceCLI
            hadoop.yarn.client.api.impl.TestNMClient
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.util.TestBoundedAppender
            hadoop.yarn.util.TestBoundedAppender
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.client.api.impl.TestNMClient
            hadoop.yarn.service.conf.TestLoadExampleAppJson
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            hadoop.yarn.service.client.TestServiceCLI
          Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.recovery.TestZKRMStateStore
            org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA
            org.apache.hadoop.yarn.client.api.impl.TestAMRMClient
            org.apache.hadoop.yarn.service.TestYarnNativeServices



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6903
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12879563/YARN-6903.yarn-native-services.01.patch
          Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc
          uname Linux 39c4729f4a20 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision yarn-native-services / f1a358e
          Default Java 1.8.0_131
          shellcheck v0.4.6
          findbugs v3.1.0-RC1
          javac https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/whitespace-tabs.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16614/testReport/
          asflicense https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16614/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 23s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 58 new or modified test files.       yarn-native-services Compile Tests 0 mvndep 3m 6s Maven dependency ordering for branch +1 mvninstall 15m 55s yarn-native-services passed +1 compile 9m 46s yarn-native-services passed +1 checkstyle 1m 31s yarn-native-services passed +1 mvnsite 6m 10s yarn-native-services passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn +1 findbugs 4m 27s yarn-native-services passed +1 javadoc 3m 44s yarn-native-services passed       Patch Compile Tests 0 mvndep 0m 13s Maven dependency ordering for patch +1 mvninstall 5m 39s the patch passed +1 compile 6m 19s the patch passed +1 cc 6m 19s the patch passed -1 javac 6m 19s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138) -0 checkstyle 1m 26s hadoop-yarn-project/hadoop-yarn: The patch generated 517 new + 1360 unchanged - 398 fixed = 1877 total (was 1758) +1 mvnsite 6m 54s the patch passed +1 shellcheck 0m 22s There were no new shellcheck issues. +1 shelldocs 0m 11s There were no new shelldocs issues. -1 whitespace 0m 0s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply -1 whitespace 0m 1s The patch 1 line(s) with tabs. +1 xml 0m 3s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn -1 findbugs 1m 6s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 30 new + 0 unchanged - 0 fixed = 30 total (was 0) -1 javadoc 1m 44s hadoop-yarn in the patch failed. -1 javadoc 0m 20s hadoop-yarn-slider-core in the patch failed.       Other Tests -1 unit 6m 0s hadoop-yarn in the patch failed. -1 unit 2m 37s hadoop-yarn-common in the patch failed. +1 unit 1m 9s hadoop-yarn-registry in the patch passed. -1 unit 47m 1s hadoop-yarn-server-resourcemanager in the patch failed. -1 unit 37m 6s hadoop-yarn-client in the patch failed. -1 unit 18m 54s hadoop-yarn-slider-core in the patch failed. +1 unit 0m 33s hadoop-yarn-services-api in the patch passed. -1 asflicense 0m 52s The patch generated 2 ASF License warnings. 199m 13s Reason Tests FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core   org.apache.hadoop.yarn.proto.ClientAMProtocol$ComponentCountProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java: [line 833]   Class org.apache.hadoop.yarn.proto.ClientAMProtocol$ComponentCountProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java   Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$ComponentCountProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java: [line 1101]   org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsRequestProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java: [line 125]   Class org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsRequestProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java   org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsResponseProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java: [line 1396]   Class org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsResponseProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java   Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$FlexComponentsResponseProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java: [line 1570]   org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusRequestProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java: [line 1734]   Class org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusRequestProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java   Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusRequestProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java: [line 1908]   org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusResponseProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java: [line 2093]   Class org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusResponseProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java   Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$GetStatusResponseProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java: [line 2328]   org.apache.hadoop.yarn.proto.ClientAMProtocol$StopRequestProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java: [line 2581]   Class org.apache.hadoop.yarn.proto.ClientAMProtocol$StopRequestProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java   Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$StopRequestProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java: [line 2755]   org.apache.hadoop.yarn.proto.ClientAMProtocol$StopResponseProto.PARSER isn't final but should be At ClientAMProtocol.java:be At ClientAMProtocol.java: [line 2919]   Class org.apache.hadoop.yarn.proto.ClientAMProtocol$StopResponseProto defines non-transient non-serializable instance field unknownFields In ClientAMProtocol.java:instance field unknownFields In ClientAMProtocol.java   Useless control flow in org.apache.hadoop.yarn.proto.ClientAMProtocol$StopResponseProto$Builder.maybeForceBuilderInitialization() At ClientAMProtocol.java: At ClientAMProtocol.java: [line 3093]   Switch statement found in org.apache.hadoop.yarn.service.client.ServiceCLI.exec(ClientArgs) where default case is missing At ServiceCLI.java:where default case is missing At ServiceCLI.java: [lines 40-71]   Boxing/unboxing to parse a primitive org.apache.hadoop.yarn.service.client.ServiceClient.parseNumberOfContainers(Component, String) At ServiceClient.java:org.apache.hadoop.yarn.service.client.ServiceClient.parseNumberOfContainers(Component, String) At ServiceClient.java: [line 237]   org.apache.hadoop.yarn.service.compinstance.ComponentInstance defines compareTo(ComponentInstance) and uses Object.equals() At ComponentInstance.java:Object.equals() At ComponentInstance.java: [lines 465-471]   Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java: [line 107]   Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java: [line 81]   Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java: [line 1966]   Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java: [line 1226]   Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java: [line 1194]   Boxing/unboxing to parse a primitive org.apache.slider.util.ServiceApiUtil.validateCompResourceSize(Resource, Application) At ServiceApiUtil.java:org.apache.slider.util.ServiceApiUtil.validateCompResourceSize(Resource, Application) At ServiceApiUtil.java: [line 354]   org.apache.slider.util.ServiceApiUtil.jsonSerDeser isn't final and can't be protected from malicious code At ServiceApiUtil.java:be protected from malicious code At ServiceApiUtil.java: [line 56] Failed junit tests hadoop.yarn.service.conf.TestLoadExampleAppJson   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   hadoop.yarn.service.client.TestServiceCLI   hadoop.yarn.client.api.impl.TestNMClient   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.util.TestBoundedAppender   hadoop.yarn.util.TestBoundedAppender   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.client.api.impl.TestNMClient   hadoop.yarn.service.conf.TestLoadExampleAppJson   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   hadoop.yarn.service.client.TestServiceCLI Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.recovery.TestZKRMStateStore   org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient   org.apache.hadoop.yarn.service.TestYarnNativeServices Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6903 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12879563/YARN-6903.yarn-native-services.01.patch Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc uname Linux 39c4729f4a20 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision yarn-native-services / f1a358e Default Java 1.8.0_131 shellcheck v0.4.6 findbugs v3.1.0-RC1 javac https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16614/testReport/ asflicense https://builds.apache.org/job/PreCommit-YARN-Build/16614/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16614/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          jianhe Jian He added a comment -

          v2 fix some jenkins issues

          Show
          jianhe Jian He added a comment - v2 fix some jenkins issues
          Hide
          vinodkv Vinod Kumar Vavilapalli added a comment -

          I think we should also split the API, client and AM modules - may be in a different JIRA.

          Show
          vinodkv Vinod Kumar Vavilapalli added a comment - I think we should also split the API, client and AM modules - may be in a different JIRA.
          Hide
          jianhe Jian He added a comment -

          yeah, makes sense. I'll do that separately.

          Show
          jianhe Jian He added a comment - yeah, makes sense. I'll do that separately.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 17s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 60 new or modified test files.
                yarn-native-services Compile Tests
          0 mvndep 3m 7s Maven dependency ordering for branch
          +1 mvninstall 14m 59s yarn-native-services passed
          +1 compile 9m 28s yarn-native-services passed
          +1 checkstyle 1m 34s yarn-native-services passed
          +1 mvnsite 6m 42s yarn-native-services passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          +1 findbugs 4m 28s yarn-native-services passed
          +1 javadoc 3m 57s yarn-native-services passed
                Patch Compile Tests
          0 mvndep 0m 12s Maven dependency ordering for patch
          +1 mvninstall 6m 3s the patch passed
          +1 compile 5m 46s the patch passed
          +1 cc 5m 46s the patch passed
          -1 javac 5m 46s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138)
          -0 checkstyle 1m 35s hadoop-yarn-project/hadoop-yarn: The patch generated 517 new + 1522 unchanged - 403 fixed = 2039 total (was 1925)
          +1 mvnsite 6m 33s the patch passed
          +1 shellcheck 0m 22s There were no new shellcheck issues.
          +1 shelldocs 0m 11s There were no new shelldocs issues.
          -1 whitespace 0m 0s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
          -1 whitespace 0m 1s The patch 1 line(s) with tabs.
          +1 xml 0m 5s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          -1 findbugs 1m 3s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
          -1 javadoc 1m 35s hadoop-yarn in the patch failed.
          -1 javadoc 0m 20s hadoop-yarn-slider in the patch failed.
          -1 javadoc 0m 20s hadoop-yarn-slider-core in the patch failed.
                Other Tests
          -1 unit 74m 4s hadoop-yarn in the patch failed.
          +1 unit 2m 50s hadoop-yarn-common in the patch passed.
          +1 unit 1m 5s hadoop-yarn-registry in the patch passed.
          -1 unit 47m 13s hadoop-yarn-server-resourcemanager in the patch failed.
          -1 unit 26m 26s hadoop-yarn-client in the patch failed.
          -1 unit 3m 33s hadoop-yarn-slider in the patch failed.
          -1 unit 3m 19s hadoop-yarn-slider-core in the patch failed.
          +1 unit 0m 27s hadoop-yarn-services-api in the patch passed.
          -1 asflicense 0m 42s The patch generated 2 ASF License warnings.
          243m 50s



          Reason Tests
          FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core
            Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:[line 107]
            Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:[line 81]
            Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:[line 1966]
            Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:[line 1226]
            Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:[line 1194]
          Failed junit tests hadoop.yarn.service.TestYarnNativeServices
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            hadoop.yarn.client.api.impl.TestNMClient
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
            hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.client.api.impl.TestNMClient
            hadoop.yarn.service.TestYarnNativeServices
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            hadoop.yarn.service.TestYarnNativeServices
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
          Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMStoreCommands
            org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6903
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12879889/YARN-6903.yarn-native-services.02.patch
          Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc
          uname Linux 2671f9d0dccb 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision yarn-native-services / f1a358e
          Default Java 1.8.0_131
          shellcheck v0.4.6
          findbugs v3.1.0-RC1
          javac https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/whitespace-tabs.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16650/testReport/
          asflicense https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16650/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 60 new or modified test files.       yarn-native-services Compile Tests 0 mvndep 3m 7s Maven dependency ordering for branch +1 mvninstall 14m 59s yarn-native-services passed +1 compile 9m 28s yarn-native-services passed +1 checkstyle 1m 34s yarn-native-services passed +1 mvnsite 6m 42s yarn-native-services passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider +1 findbugs 4m 28s yarn-native-services passed +1 javadoc 3m 57s yarn-native-services passed       Patch Compile Tests 0 mvndep 0m 12s Maven dependency ordering for patch +1 mvninstall 6m 3s the patch passed +1 compile 5m 46s the patch passed +1 cc 5m 46s the patch passed -1 javac 5m 46s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138) -0 checkstyle 1m 35s hadoop-yarn-project/hadoop-yarn: The patch generated 517 new + 1522 unchanged - 403 fixed = 2039 total (was 1925) +1 mvnsite 6m 33s the patch passed +1 shellcheck 0m 22s There were no new shellcheck issues. +1 shelldocs 0m 11s There were no new shelldocs issues. -1 whitespace 0m 0s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply -1 whitespace 0m 1s The patch 1 line(s) with tabs. +1 xml 0m 5s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider -1 findbugs 1m 3s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0) -1 javadoc 1m 35s hadoop-yarn in the patch failed. -1 javadoc 0m 20s hadoop-yarn-slider in the patch failed. -1 javadoc 0m 20s hadoop-yarn-slider-core in the patch failed.       Other Tests -1 unit 74m 4s hadoop-yarn in the patch failed. +1 unit 2m 50s hadoop-yarn-common in the patch passed. +1 unit 1m 5s hadoop-yarn-registry in the patch passed. -1 unit 47m 13s hadoop-yarn-server-resourcemanager in the patch failed. -1 unit 26m 26s hadoop-yarn-client in the patch failed. -1 unit 3m 33s hadoop-yarn-slider in the patch failed. -1 unit 3m 19s hadoop-yarn-slider-core in the patch failed. +1 unit 0m 27s hadoop-yarn-services-api in the patch passed. -1 asflicense 0m 42s The patch generated 2 ASF License warnings. 243m 50s Reason Tests FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core   Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java: [line 107]   Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java: [line 81]   Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java: [line 1966]   Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java: [line 1226]   Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java: [line 1194] Failed junit tests hadoop.yarn.service.TestYarnNativeServices   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   hadoop.yarn.client.api.impl.TestNMClient   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.client.api.impl.TestNMClient   hadoop.yarn.service.TestYarnNativeServices   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   hadoop.yarn.service.TestYarnNativeServices   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMStoreCommands   org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6903 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12879889/YARN-6903.yarn-native-services.02.patch Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc uname Linux 2671f9d0dccb 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision yarn-native-services / f1a358e Default Java 1.8.0_131 shellcheck v0.4.6 findbugs v3.1.0-RC1 javac https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16650/testReport/ asflicense https://builds.apache.org/job/PreCommit-YARN-Build/16650/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16650/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 24s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 60 new or modified test files.
                yarn-native-services Compile Tests
          0 mvndep 3m 31s Maven dependency ordering for branch
          +1 mvninstall 15m 24s yarn-native-services passed
          +1 compile 10m 32s yarn-native-services passed
          +1 checkstyle 1m 49s yarn-native-services passed
          -1 mvnsite 0m 33s hadoop-yarn-common in yarn-native-services failed.
          -1 mvnsite 0m 35s hadoop-yarn-server-resourcemanager in yarn-native-services failed.
          -1 mvnsite 0m 30s hadoop-yarn-slider in yarn-native-services failed.
          -1 mvnsite 0m 27s hadoop-yarn-slider-core in yarn-native-services failed.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          -1 findbugs 0m 22s hadoop-yarn-common in yarn-native-services failed.
          -1 findbugs 0m 26s hadoop-yarn-server-resourcemanager in yarn-native-services failed.
          -1 findbugs 0m 26s hadoop-yarn-slider-core in yarn-native-services failed.
          +1 javadoc 4m 34s yarn-native-services passed
                Patch Compile Tests
          0 mvndep 0m 13s Maven dependency ordering for patch
          +1 mvninstall 7m 3s the patch passed
          +1 compile 6m 42s the patch passed
          +1 cc 6m 42s the patch passed
          -1 javac 6m 42s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138)
          -0 checkstyle 1m 31s hadoop-yarn-project/hadoop-yarn: The patch generated 518 new + 1522 unchanged - 403 fixed = 2040 total (was 1925)
          +1 mvnsite 7m 46s the patch passed
          +1 shellcheck 0m 24s There were no new shellcheck issues.
          +1 shelldocs 0m 11s There were no new shelldocs issues.
          -1 whitespace 0m 0s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
          -1 whitespace 0m 1s The patch 1 line(s) with tabs.
          +1 xml 0m 5s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          +1 findbugs 5m 25s the patch passed
          -1 javadoc 1m 46s hadoop-yarn in the patch failed.
          +1 javadoc 0m 33s hadoop-yarn-common in the patch passed.
          +1 javadoc 0m 18s hadoop-yarn-registry in the patch passed.
          +1 javadoc 0m 24s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager generated 0 new + 859 unchanged - 14 fixed = 859 total (was 873)
          +1 javadoc 0m 18s hadoop-yarn-client in the patch passed.
          -1 javadoc 0m 20s hadoop-yarn-slider in the patch failed.
          -1 javadoc 0m 21s hadoop-yarn-slider-core in the patch failed.
          +1 javadoc 0m 14s hadoop-yarn-services-api in the patch passed.
                Other Tests
          -1 unit 88m 29s hadoop-yarn in the patch failed.
          +1 unit 3m 7s hadoop-yarn-common in the patch passed.
          +1 unit 1m 23s hadoop-yarn-registry in the patch passed.
          -1 unit 51m 39s hadoop-yarn-server-resourcemanager in the patch failed.
          -1 unit 26m 20s hadoop-yarn-client in the patch failed.
          -1 unit 19m 1s hadoop-yarn-slider in the patch failed.
          -1 unit 19m 10s hadoop-yarn-slider-core in the patch failed.
          +1 unit 0m 37s hadoop-yarn-services-api in the patch passed.
          -1 asflicense 0m 54s The patch generated 2 ASF License warnings.
          299m 49s



          Reason Tests
          Failed junit tests slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            hadoop.yarn.client.api.impl.TestNMClient
            hadoop.yarn.client.api.impl.TestAMRMClient
            hadoop.yarn.server.nodemanager.containermanager.TestContainerManager
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
            hadoop.yarn.client.api.impl.TestNMClient
            hadoop.yarn.client.api.impl.TestAMRMClient
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
          Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMStoreCommands
            org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA
            org.apache.hadoop.yarn.server.resourcemanager.TestReservationSystemWithRMHA
            org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA
            org.apache.hadoop.yarn.service.TestYarnNativeServices
            org.apache.hadoop.yarn.service.TestYarnNativeServices



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6903
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12880736/YARN-6903.yarn-native-services.03.patch
          Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc
          uname Linux cf6bc7b49eac 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision yarn-native-services / f1a358e
          Default Java 1.8.0_131
          mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
          mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          shellcheck v0.4.6
          findbugs v3.1.0-RC1
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          javac https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/whitespace-tabs.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16759/testReport/
          asflicense https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16759/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 24s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 60 new or modified test files.       yarn-native-services Compile Tests 0 mvndep 3m 31s Maven dependency ordering for branch +1 mvninstall 15m 24s yarn-native-services passed +1 compile 10m 32s yarn-native-services passed +1 checkstyle 1m 49s yarn-native-services passed -1 mvnsite 0m 33s hadoop-yarn-common in yarn-native-services failed. -1 mvnsite 0m 35s hadoop-yarn-server-resourcemanager in yarn-native-services failed. -1 mvnsite 0m 30s hadoop-yarn-slider in yarn-native-services failed. -1 mvnsite 0m 27s hadoop-yarn-slider-core in yarn-native-services failed. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider -1 findbugs 0m 22s hadoop-yarn-common in yarn-native-services failed. -1 findbugs 0m 26s hadoop-yarn-server-resourcemanager in yarn-native-services failed. -1 findbugs 0m 26s hadoop-yarn-slider-core in yarn-native-services failed. +1 javadoc 4m 34s yarn-native-services passed       Patch Compile Tests 0 mvndep 0m 13s Maven dependency ordering for patch +1 mvninstall 7m 3s the patch passed +1 compile 6m 42s the patch passed +1 cc 6m 42s the patch passed -1 javac 6m 42s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138) -0 checkstyle 1m 31s hadoop-yarn-project/hadoop-yarn: The patch generated 518 new + 1522 unchanged - 403 fixed = 2040 total (was 1925) +1 mvnsite 7m 46s the patch passed +1 shellcheck 0m 24s There were no new shellcheck issues. +1 shelldocs 0m 11s There were no new shelldocs issues. -1 whitespace 0m 0s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply -1 whitespace 0m 1s The patch 1 line(s) with tabs. +1 xml 0m 5s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider +1 findbugs 5m 25s the patch passed -1 javadoc 1m 46s hadoop-yarn in the patch failed. +1 javadoc 0m 33s hadoop-yarn-common in the patch passed. +1 javadoc 0m 18s hadoop-yarn-registry in the patch passed. +1 javadoc 0m 24s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager generated 0 new + 859 unchanged - 14 fixed = 859 total (was 873) +1 javadoc 0m 18s hadoop-yarn-client in the patch passed. -1 javadoc 0m 20s hadoop-yarn-slider in the patch failed. -1 javadoc 0m 21s hadoop-yarn-slider-core in the patch failed. +1 javadoc 0m 14s hadoop-yarn-services-api in the patch passed.       Other Tests -1 unit 88m 29s hadoop-yarn in the patch failed. +1 unit 3m 7s hadoop-yarn-common in the patch passed. +1 unit 1m 23s hadoop-yarn-registry in the patch passed. -1 unit 51m 39s hadoop-yarn-server-resourcemanager in the patch failed. -1 unit 26m 20s hadoop-yarn-client in the patch failed. -1 unit 19m 1s hadoop-yarn-slider in the patch failed. -1 unit 19m 10s hadoop-yarn-slider-core in the patch failed. +1 unit 0m 37s hadoop-yarn-services-api in the patch passed. -1 asflicense 0m 54s The patch generated 2 ASF License warnings. 299m 49s Reason Tests Failed junit tests slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   hadoop.yarn.client.api.impl.TestNMClient   hadoop.yarn.client.api.impl.TestAMRMClient   hadoop.yarn.server.nodemanager.containermanager.TestContainerManager   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities   hadoop.yarn.client.api.impl.TestNMClient   hadoop.yarn.client.api.impl.TestAMRMClient   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMStoreCommands   org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA   org.apache.hadoop.yarn.server.resourcemanager.TestReservationSystemWithRMHA   org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA   org.apache.hadoop.yarn.service.TestYarnNativeServices   org.apache.hadoop.yarn.service.TestYarnNativeServices Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6903 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12880736/YARN-6903.yarn-native-services.03.patch Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc uname Linux cf6bc7b49eac 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision yarn-native-services / f1a358e Default Java 1.8.0_131 mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt shellcheck v0.4.6 findbugs v3.1.0-RC1 findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt javac https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/whitespace-tabs.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16759/testReport/ asflicense https://builds.apache.org/job/PreCommit-YARN-Build/16759/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16759/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 19s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 60 new or modified test files.
                yarn-native-services Compile Tests
          0 mvndep 3m 3s Maven dependency ordering for branch
          +1 mvninstall 16m 32s yarn-native-services passed
          +1 compile 10m 19s yarn-native-services passed
          +1 checkstyle 1m 33s yarn-native-services passed
          +1 mvnsite 7m 43s yarn-native-services passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          +1 findbugs 5m 12s yarn-native-services passed
          +1 javadoc 4m 31s yarn-native-services passed
                Patch Compile Tests
          0 mvndep 0m 15s Maven dependency ordering for patch
          +1 mvninstall 7m 28s the patch passed
          +1 compile 6m 50s the patch passed
          +1 cc 6m 50s the patch passed
          -1 javac 6m 50s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138)
          -0 checkstyle 1m 36s hadoop-yarn-project/hadoop-yarn: The patch generated 517 new + 1521 unchanged - 403 fixed = 2038 total (was 1924)
          +1 mvnsite 7m 46s the patch passed
          +1 shellcheck 0m 25s There were no new shellcheck issues.
          +1 shelldocs 0m 12s There were no new shelldocs issues.
          -1 whitespace 0m 1s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
          -1 whitespace 0m 1s The patch 1 line(s) with tabs.
          +1 xml 0m 5s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          -1 findbugs 1m 17s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
          -1 javadoc 1m 44s hadoop-yarn in the patch failed.
          -1 javadoc 0m 19s hadoop-yarn-slider in the patch failed.
          -1 javadoc 0m 19s hadoop-yarn-slider-core in the patch failed.
                Other Tests
          -1 unit 72m 43s hadoop-yarn in the patch failed.
          +1 unit 2m 50s hadoop-yarn-common in the patch passed.
          +1 unit 1m 2s hadoop-yarn-registry in the patch passed.
          -1 unit 45m 8s hadoop-yarn-server-resourcemanager in the patch failed.
          -1 unit 25m 27s hadoop-yarn-client in the patch failed.
          -1 unit 18m 23s hadoop-yarn-slider in the patch failed.
          -1 unit 18m 12s hadoop-yarn-slider-core in the patch failed.
          +1 unit 0m 28s hadoop-yarn-services-api in the patch passed.
          +1 asflicense 0m 44s The patch does not generate ASF License warnings.
          278m 46s



          Reason Tests
          FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core
            Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:[line 107]
            Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:[line 81]
            Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:[line 1966]
            Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:[line 1226]
            Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:[line 1194]
          Failed junit tests hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.client.api.impl.TestAMRMProxy
            hadoop.yarn.client.api.impl.TestNMClient
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.client.api.impl.TestAMRMProxy
            hadoop.yarn.client.api.impl.TestNMClient
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
          Timed out junit tests org.apache.hadoop.yarn.service.TestYarnNativeServices
            org.apache.hadoop.yarn.service.TestYarnNativeServices



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6903
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12880971/YARN-6903.yarn-native-services.04.patch
          Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc
          uname Linux 2d7e8574576e 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision yarn-native-services / f1a358e
          Default Java 1.8.0_131
          shellcheck v0.4.6
          findbugs v3.1.0-RC1
          javac https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/whitespace-tabs.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16799/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16799/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 19s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 60 new or modified test files.       yarn-native-services Compile Tests 0 mvndep 3m 3s Maven dependency ordering for branch +1 mvninstall 16m 32s yarn-native-services passed +1 compile 10m 19s yarn-native-services passed +1 checkstyle 1m 33s yarn-native-services passed +1 mvnsite 7m 43s yarn-native-services passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider +1 findbugs 5m 12s yarn-native-services passed +1 javadoc 4m 31s yarn-native-services passed       Patch Compile Tests 0 mvndep 0m 15s Maven dependency ordering for patch +1 mvninstall 7m 28s the patch passed +1 compile 6m 50s the patch passed +1 cc 6m 50s the patch passed -1 javac 6m 50s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138) -0 checkstyle 1m 36s hadoop-yarn-project/hadoop-yarn: The patch generated 517 new + 1521 unchanged - 403 fixed = 2038 total (was 1924) +1 mvnsite 7m 46s the patch passed +1 shellcheck 0m 25s There were no new shellcheck issues. +1 shelldocs 0m 12s There were no new shelldocs issues. -1 whitespace 0m 1s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply -1 whitespace 0m 1s The patch 1 line(s) with tabs. +1 xml 0m 5s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider -1 findbugs 1m 17s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0) -1 javadoc 1m 44s hadoop-yarn in the patch failed. -1 javadoc 0m 19s hadoop-yarn-slider in the patch failed. -1 javadoc 0m 19s hadoop-yarn-slider-core in the patch failed.       Other Tests -1 unit 72m 43s hadoop-yarn in the patch failed. +1 unit 2m 50s hadoop-yarn-common in the patch passed. +1 unit 1m 2s hadoop-yarn-registry in the patch passed. -1 unit 45m 8s hadoop-yarn-server-resourcemanager in the patch failed. -1 unit 25m 27s hadoop-yarn-client in the patch failed. -1 unit 18m 23s hadoop-yarn-slider in the patch failed. -1 unit 18m 12s hadoop-yarn-slider-core in the patch failed. +1 unit 0m 28s hadoop-yarn-services-api in the patch passed. +1 asflicense 0m 44s The patch does not generate ASF License warnings. 278m 46s Reason Tests FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core   Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java: [line 107]   Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java: [line 81]   Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java: [line 1966]   Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java: [line 1226]   Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java: [line 1194] Failed junit tests hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.client.api.impl.TestAMRMProxy   hadoop.yarn.client.api.impl.TestNMClient   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.client.api.impl.TestAMRMProxy   hadoop.yarn.client.api.impl.TestNMClient   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles Timed out junit tests org.apache.hadoop.yarn.service.TestYarnNativeServices   org.apache.hadoop.yarn.service.TestYarnNativeServices Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6903 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12880971/YARN-6903.yarn-native-services.04.patch Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc uname Linux 2d7e8574576e 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision yarn-native-services / f1a358e Default Java 1.8.0_131 shellcheck v0.4.6 findbugs v3.1.0-RC1 javac https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16799/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16799/testReport/ modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16799/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 16s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 61 new or modified test files.
                yarn-native-services Compile Tests
          0 mvndep 0m 59s Maven dependency ordering for branch
          +1 mvninstall 15m 12s yarn-native-services passed
          +1 compile 9m 23s yarn-native-services passed
          +1 checkstyle 1m 35s yarn-native-services passed
          +1 mvnsite 6m 57s yarn-native-services passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          +1 findbugs 4m 42s yarn-native-services passed
          +1 javadoc 4m 11s yarn-native-services passed
                Patch Compile Tests
          0 mvndep 0m 13s Maven dependency ordering for patch
          -1 mvninstall 3m 6s hadoop-yarn in the patch failed.
          -1 mvninstall 0m 33s hadoop-yarn-slider in the patch failed.
          -1 mvninstall 0m 34s hadoop-yarn-slider-core in the patch failed.
          -1 mvninstall 0m 16s hadoop-yarn-services-api in the patch failed.
          -1 compile 3m 10s hadoop-yarn in the patch failed.
          -1 cc 3m 10s hadoop-yarn in the patch failed.
          -1 javac 3m 10s hadoop-yarn in the patch failed.
          -0 checkstyle 1m 23s hadoop-yarn-project/hadoop-yarn: The patch generated 518 new + 1523 unchanged - 403 fixed = 2041 total (was 1926)
          -1 mvnsite 3m 12s hadoop-yarn in the patch failed.
          -1 mvnsite 0m 37s hadoop-yarn-slider in the patch failed.
          -1 mvnsite 0m 34s hadoop-yarn-slider-core in the patch failed.
          -1 mvnsite 0m 18s hadoop-yarn-services-api in the patch failed.
          +1 shellcheck 0m 24s There were no new shellcheck issues.
          +1 shelldocs 0m 11s There were no new shelldocs issues.
          -1 whitespace 0m 1s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
          -1 whitespace 0m 2s The patch 1 line(s) with tabs.
          +1 xml 0m 5s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          -1 findbugs 0m 21s hadoop-yarn-slider-core in the patch failed.
          -1 findbugs 0m 16s hadoop-yarn-services-api in the patch failed.
          -1 javadoc 1m 53s hadoop-yarn in the patch failed.
          -1 javadoc 0m 23s hadoop-yarn-slider in the patch failed.
          -1 javadoc 0m 21s hadoop-yarn-slider-core in the patch failed.
          -1 javadoc 0m 18s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)
                Other Tests
          -1 unit 70m 19s hadoop-yarn in the patch failed.
          +1 unit 2m 30s hadoop-yarn-common in the patch passed.
          +1 unit 0m 56s hadoop-yarn-registry in the patch passed.
          -1 unit 43m 16s hadoop-yarn-server-resourcemanager in the patch failed.
          -1 unit 25m 28s hadoop-yarn-client in the patch failed.
          -1 unit 1m 18s hadoop-yarn-slider in the patch failed.
          -1 unit 0m 35s hadoop-yarn-slider-core in the patch failed.
          -1 unit 0m 28s hadoop-yarn-services-api in the patch failed.
          +1 asflicense 0m 39s The patch does not generate ASF License warnings.
          225m 58s



          Reason Tests
          Failed junit tests hadoop.yarn.client.api.impl.TestAMRMClient
            hadoop.yarn.client.api.impl.TestNMClient
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.client.api.impl.TestAMRMClient
            hadoop.yarn.client.api.impl.TestNMClient



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6903
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12881073/YARN-6903.yarn-native-services.05.patch
          Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc
          uname Linux b2a162744b47 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision yarn-native-services / f1a358e
          Default Java 1.8.0_131
          shellcheck v0.4.6
          findbugs v3.1.0-RC1
          mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn.txt
          mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt
          compile https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt
          cc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt
          javac https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn.txt
          mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/whitespace-tabs.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16810/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16810/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 16s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 61 new or modified test files.       yarn-native-services Compile Tests 0 mvndep 0m 59s Maven dependency ordering for branch +1 mvninstall 15m 12s yarn-native-services passed +1 compile 9m 23s yarn-native-services passed +1 checkstyle 1m 35s yarn-native-services passed +1 mvnsite 6m 57s yarn-native-services passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider +1 findbugs 4m 42s yarn-native-services passed +1 javadoc 4m 11s yarn-native-services passed       Patch Compile Tests 0 mvndep 0m 13s Maven dependency ordering for patch -1 mvninstall 3m 6s hadoop-yarn in the patch failed. -1 mvninstall 0m 33s hadoop-yarn-slider in the patch failed. -1 mvninstall 0m 34s hadoop-yarn-slider-core in the patch failed. -1 mvninstall 0m 16s hadoop-yarn-services-api in the patch failed. -1 compile 3m 10s hadoop-yarn in the patch failed. -1 cc 3m 10s hadoop-yarn in the patch failed. -1 javac 3m 10s hadoop-yarn in the patch failed. -0 checkstyle 1m 23s hadoop-yarn-project/hadoop-yarn: The patch generated 518 new + 1523 unchanged - 403 fixed = 2041 total (was 1926) -1 mvnsite 3m 12s hadoop-yarn in the patch failed. -1 mvnsite 0m 37s hadoop-yarn-slider in the patch failed. -1 mvnsite 0m 34s hadoop-yarn-slider-core in the patch failed. -1 mvnsite 0m 18s hadoop-yarn-services-api in the patch failed. +1 shellcheck 0m 24s There were no new shellcheck issues. +1 shelldocs 0m 11s There were no new shelldocs issues. -1 whitespace 0m 1s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply -1 whitespace 0m 2s The patch 1 line(s) with tabs. +1 xml 0m 5s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider -1 findbugs 0m 21s hadoop-yarn-slider-core in the patch failed. -1 findbugs 0m 16s hadoop-yarn-services-api in the patch failed. -1 javadoc 1m 53s hadoop-yarn in the patch failed. -1 javadoc 0m 23s hadoop-yarn-slider in the patch failed. -1 javadoc 0m 21s hadoop-yarn-slider-core in the patch failed. -1 javadoc 0m 18s hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)       Other Tests -1 unit 70m 19s hadoop-yarn in the patch failed. +1 unit 2m 30s hadoop-yarn-common in the patch passed. +1 unit 0m 56s hadoop-yarn-registry in the patch passed. -1 unit 43m 16s hadoop-yarn-server-resourcemanager in the patch failed. -1 unit 25m 28s hadoop-yarn-client in the patch failed. -1 unit 1m 18s hadoop-yarn-slider in the patch failed. -1 unit 0m 35s hadoop-yarn-slider-core in the patch failed. -1 unit 0m 28s hadoop-yarn-services-api in the patch failed. +1 asflicense 0m 39s The patch does not generate ASF License warnings. 225m 58s Reason Tests Failed junit tests hadoop.yarn.client.api.impl.TestAMRMClient   hadoop.yarn.client.api.impl.TestNMClient   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.client.api.impl.TestAMRMClient   hadoop.yarn.client.api.impl.TestNMClient Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6903 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12881073/YARN-6903.yarn-native-services.05.patch Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc uname Linux b2a162744b47 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision yarn-native-services / f1a358e Default Java 1.8.0_131 shellcheck v0.4.6 findbugs v3.1.0-RC1 mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn.txt mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt compile https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt cc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt javac https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn.txt mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/diff-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16810/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-services-api.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16810/testReport/ modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16810/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 20s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 62 new or modified test files.
                yarn-native-services Compile Tests
          0 mvndep 1m 2s Maven dependency ordering for branch
          +1 mvninstall 16m 57s yarn-native-services passed
          +1 compile 10m 38s yarn-native-services passed
          +1 checkstyle 1m 46s yarn-native-services passed
          +1 mvnsite 8m 33s yarn-native-services passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          +1 findbugs 5m 51s yarn-native-services passed
          +1 javadoc 5m 16s yarn-native-services passed
                Patch Compile Tests
          0 mvndep 0m 15s Maven dependency ordering for patch
          +1 mvninstall 8m 11s the patch passed
          +1 compile 7m 0s the patch passed
          +1 cc 7m 0s the patch passed
          -1 javac 7m 0s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138)
          -0 checkstyle 1m 44s hadoop-yarn-project/hadoop-yarn: The patch generated 518 new + 1523 unchanged - 405 fixed = 2041 total (was 1928)
          +1 mvnsite 8m 13s the patch passed
          +1 shellcheck 0m 26s There were no new shellcheck issues.
          +1 shelldocs 0m 13s There were no new shelldocs issues.
          -1 whitespace 0m 1s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
          -1 whitespace 0m 2s The patch 1 line(s) with tabs.
          +1 xml 0m 6s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          -1 findbugs 1m 23s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
          -1 javadoc 1m 40s hadoop-yarn in the patch failed.
          -1 javadoc 0m 23s hadoop-yarn-slider in the patch failed.
          -1 javadoc 0m 21s hadoop-yarn-slider-core in the patch failed.
                Other Tests
          -1 unit 73m 27s hadoop-yarn in the patch failed.
          +1 unit 2m 34s hadoop-yarn-common in the patch passed.
          +1 unit 0m 55s hadoop-yarn-registry in the patch passed.
          -1 unit 43m 39s hadoop-yarn-server-resourcemanager in the patch failed.
          -1 unit 25m 26s hadoop-yarn-client in the patch failed.
          -1 unit 18m 9s hadoop-yarn-slider in the patch failed.
          -1 unit 18m 29s hadoop-yarn-slider-core in the patch failed.
          +1 unit 0m 26s hadoop-yarn-services-api in the patch passed.
          +1 asflicense 0m 41s The patch does not generate ASF License warnings.
          281m 25s



          Reason Tests
          FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core
            Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:[line 107]
            Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:[line 81]
            Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:[line 1966]
            Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:[line 1226]
            Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:[line 1194]
          Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
            hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation
            hadoop.yarn.client.api.impl.TestNMClient
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
            hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation
            hadoop.yarn.client.api.impl.TestNMClient
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
            slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles
          Timed out junit tests org.apache.hadoop.yarn.service.TestYarnNativeServices
            org.apache.hadoop.yarn.service.TestYarnNativeServices



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6903
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12881286/YARN-6903.yarn-native-services.06.patch
          Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc
          uname Linux 38c294dc3f4b 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision yarn-native-services / f1a358e
          Default Java 1.8.0_131
          shellcheck v0.4.6
          findbugs v3.1.0-RC1
          javac https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/whitespace-tabs.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16829/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16829/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 20s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 62 new or modified test files.       yarn-native-services Compile Tests 0 mvndep 1m 2s Maven dependency ordering for branch +1 mvninstall 16m 57s yarn-native-services passed +1 compile 10m 38s yarn-native-services passed +1 checkstyle 1m 46s yarn-native-services passed +1 mvnsite 8m 33s yarn-native-services passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider +1 findbugs 5m 51s yarn-native-services passed +1 javadoc 5m 16s yarn-native-services passed       Patch Compile Tests 0 mvndep 0m 15s Maven dependency ordering for patch +1 mvninstall 8m 11s the patch passed +1 compile 7m 0s the patch passed +1 cc 7m 0s the patch passed -1 javac 7m 0s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138) -0 checkstyle 1m 44s hadoop-yarn-project/hadoop-yarn: The patch generated 518 new + 1523 unchanged - 405 fixed = 2041 total (was 1928) +1 mvnsite 8m 13s the patch passed +1 shellcheck 0m 26s There were no new shellcheck issues. +1 shelldocs 0m 13s There were no new shelldocs issues. -1 whitespace 0m 1s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply -1 whitespace 0m 2s The patch 1 line(s) with tabs. +1 xml 0m 6s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider -1 findbugs 1m 23s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0) -1 javadoc 1m 40s hadoop-yarn in the patch failed. -1 javadoc 0m 23s hadoop-yarn-slider in the patch failed. -1 javadoc 0m 21s hadoop-yarn-slider-core in the patch failed.       Other Tests -1 unit 73m 27s hadoop-yarn in the patch failed. +1 unit 2m 34s hadoop-yarn-common in the patch passed. +1 unit 0m 55s hadoop-yarn-registry in the patch passed. -1 unit 43m 39s hadoop-yarn-server-resourcemanager in the patch failed. -1 unit 25m 26s hadoop-yarn-client in the patch failed. -1 unit 18m 9s hadoop-yarn-slider in the patch failed. -1 unit 18m 29s hadoop-yarn-slider-core in the patch failed. +1 unit 0m 26s hadoop-yarn-services-api in the patch passed. +1 asflicense 0m 41s The patch does not generate ASF License warnings. 281m 25s Reason Tests FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core   Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java: [line 107]   Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java: [line 81]   Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java: [line 1966]   Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java: [line 1226]   Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java: [line 1194] Failed junit tests hadoop.yarn.server.TestMiniYarnClusterNodeUtilization   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer   hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation   hadoop.yarn.client.api.impl.TestNMClient   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer   hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation   hadoop.yarn.client.api.impl.TestNMClient   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles   slider.server.appmaster.model.appstate.TestMockAppStateDynamicRoles Timed out junit tests org.apache.hadoop.yarn.service.TestYarnNativeServices   org.apache.hadoop.yarn.service.TestYarnNativeServices Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6903 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12881286/YARN-6903.yarn-native-services.06.patch Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc uname Linux 38c294dc3f4b 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision yarn-native-services / f1a358e Default Java 1.8.0_131 shellcheck v0.4.6 findbugs v3.1.0-RC1 javac https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16829/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16829/testReport/ modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16829/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          jianhe Jian He added a comment -

          Not sure why the TestYarnNativeService always timed out on jenkins. Uploaded a new patch which commented out the old tests and only run the new ones.

          Show
          jianhe Jian He added a comment - Not sure why the TestYarnNativeService always timed out on jenkins. Uploaded a new patch which commented out the old tests and only run the new ones.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 19s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 114 new or modified test files.
                yarn-native-services Compile Tests
          0 mvndep 0m 59s Maven dependency ordering for branch
          +1 mvninstall 17m 5s yarn-native-services passed
          +1 compile 11m 32s yarn-native-services passed
          +1 checkstyle 1m 40s yarn-native-services passed
          +1 mvnsite 8m 2s yarn-native-services passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          +1 findbugs 5m 50s yarn-native-services passed
          +1 javadoc 5m 8s yarn-native-services passed
                Patch Compile Tests
          0 mvndep 0m 13s Maven dependency ordering for patch
          +1 mvninstall 6m 8s the patch passed
          +1 compile 5m 44s the patch passed
          +1 cc 5m 44s the patch passed
          -1 javac 5m 44s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138)
          -0 checkstyle 1m 35s hadoop-yarn-project/hadoop-yarn: The patch generated 581 new + 1569 unchanged - 405 fixed = 2150 total (was 1974)
          +1 mvnsite 6m 30s the patch passed
          +1 shellcheck 0m 24s There were no new shellcheck issues.
          +1 shelldocs 0m 12s There were no new shelldocs issues.
          -1 whitespace 0m 0s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
          -1 whitespace 0m 1s The patch 1 line(s) with tabs.
          +1 xml 0m 5s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          -1 findbugs 1m 4s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
          -1 javadoc 1m 35s hadoop-yarn in the patch failed.
          -1 javadoc 0m 19s hadoop-yarn-slider in the patch failed.
          -1 javadoc 0m 19s hadoop-yarn-slider-core in the patch failed.
                Other Tests
          -1 unit 69m 34s hadoop-yarn in the patch failed.
          +1 unit 2m 32s hadoop-yarn-common in the patch passed.
          +1 unit 0m 56s hadoop-yarn-registry in the patch passed.
          -1 unit 43m 1s hadoop-yarn-server-resourcemanager in the patch failed.
          -1 unit 25m 24s hadoop-yarn-client in the patch failed.
          -1 unit 15m 59s hadoop-yarn-slider in the patch failed.
          -1 unit 16m 1s hadoop-yarn-slider-core in the patch failed.
          +1 unit 0m 26s hadoop-yarn-services-api in the patch passed.
          +1 asflicense 0m 39s The patch does not generate ASF License warnings.
          265m 13s



          Reason Tests
          FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core
            Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:[line 107]
            Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:[line 81]
            Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:[line 1966]
            Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:[line 1226]
            Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:[line 1194]
          Failed junit tests hadoop.yarn.client.api.impl.TestNMClient
            hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
            hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation
            hadoop.yarn.server.resourcemanager.TestRMRestart
            hadoop.yarn.client.api.impl.TestNMClient
          Timed out junit tests org.apache.hadoop.yarn.service.TestYarnNativeServices
            org.apache.hadoop.yarn.service.TestYarnNativeServices



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6903
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12881364/YARN-6903.yarn-native-services.07.patch
          Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc
          uname Linux 89599d2df973 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision yarn-native-services / f1a358e
          Default Java 1.8.0_144
          shellcheck v0.4.6
          findbugs v3.1.0-RC1
          javac https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/whitespace-tabs.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16846/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16846/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 19s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 114 new or modified test files.       yarn-native-services Compile Tests 0 mvndep 0m 59s Maven dependency ordering for branch +1 mvninstall 17m 5s yarn-native-services passed +1 compile 11m 32s yarn-native-services passed +1 checkstyle 1m 40s yarn-native-services passed +1 mvnsite 8m 2s yarn-native-services passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider +1 findbugs 5m 50s yarn-native-services passed +1 javadoc 5m 8s yarn-native-services passed       Patch Compile Tests 0 mvndep 0m 13s Maven dependency ordering for patch +1 mvninstall 6m 8s the patch passed +1 compile 5m 44s the patch passed +1 cc 5m 44s the patch passed -1 javac 5m 44s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138) -0 checkstyle 1m 35s hadoop-yarn-project/hadoop-yarn: The patch generated 581 new + 1569 unchanged - 405 fixed = 2150 total (was 1974) +1 mvnsite 6m 30s the patch passed +1 shellcheck 0m 24s There were no new shellcheck issues. +1 shelldocs 0m 12s There were no new shelldocs issues. -1 whitespace 0m 0s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply -1 whitespace 0m 1s The patch 1 line(s) with tabs. +1 xml 0m 5s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider -1 findbugs 1m 4s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0) -1 javadoc 1m 35s hadoop-yarn in the patch failed. -1 javadoc 0m 19s hadoop-yarn-slider in the patch failed. -1 javadoc 0m 19s hadoop-yarn-slider-core in the patch failed.       Other Tests -1 unit 69m 34s hadoop-yarn in the patch failed. +1 unit 2m 32s hadoop-yarn-common in the patch passed. +1 unit 0m 56s hadoop-yarn-registry in the patch passed. -1 unit 43m 1s hadoop-yarn-server-resourcemanager in the patch failed. -1 unit 25m 24s hadoop-yarn-client in the patch failed. -1 unit 15m 59s hadoop-yarn-slider in the patch failed. -1 unit 16m 1s hadoop-yarn-slider-core in the patch failed. +1 unit 0m 26s hadoop-yarn-services-api in the patch passed. +1 asflicense 0m 39s The patch does not generate ASF License warnings. 265m 13s Reason Tests FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core   Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java: [line 107]   Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java: [line 81]   Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java: [line 1966]   Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java: [line 1226]   Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java: [line 1194] Failed junit tests hadoop.yarn.client.api.impl.TestNMClient   hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities   hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.client.api.impl.TestNMClient Timed out junit tests org.apache.hadoop.yarn.service.TestYarnNativeServices   org.apache.hadoop.yarn.service.TestYarnNativeServices Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6903 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12881364/YARN-6903.yarn-native-services.07.patch Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc uname Linux 89599d2df973 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision yarn-native-services / f1a358e Default Java 1.8.0_144 shellcheck v0.4.6 findbugs v3.1.0-RC1 javac https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16846/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16846/testReport/ modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16846/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 15s Docker mode activated.
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 114 new or modified test files.
                yarn-native-services Compile Tests
          0 mvndep 3m 8s Maven dependency ordering for branch
          +1 mvninstall 16m 15s yarn-native-services passed
          +1 compile 9m 46s yarn-native-services passed
          +1 checkstyle 1m 41s yarn-native-services passed
          +1 mvnsite 7m 30s yarn-native-services passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          +1 findbugs 5m 1s yarn-native-services passed
          +1 javadoc 3m 59s yarn-native-services passed
                Patch Compile Tests
          0 mvndep 0m 13s Maven dependency ordering for patch
          +1 mvninstall 6m 4s the patch passed
          +1 compile 5m 39s the patch passed
          +1 cc 5m 39s the patch passed
          -1 javac 5m 39s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138)
          -0 checkstyle 1m 37s hadoop-yarn-project/hadoop-yarn: The patch generated 586 new + 1572 unchanged - 407 fixed = 2158 total (was 1979)
          +1 mvnsite 7m 10s the patch passed
          +1 shellcheck 0m 23s There were no new shellcheck issues.
          +1 shelldocs 0m 12s There were no new shelldocs issues.
          -1 whitespace 0m 1s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
          -1 whitespace 0m 2s The patch 1 line(s) with tabs.
          +1 xml 0m 7s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider
          -1 findbugs 1m 18s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 7 new + 0 unchanged - 0 fixed = 7 total (was 0)
          -1 javadoc 1m 48s hadoop-yarn in the patch failed.
          -1 javadoc 0m 20s hadoop-yarn-slider in the patch failed.
          -1 javadoc 0m 19s hadoop-yarn-slider-core in the patch failed.
                Other Tests
          -1 unit 76m 35s hadoop-yarn in the patch failed.
          +1 unit 3m 4s hadoop-yarn-common in the patch passed.
          +1 unit 1m 8s hadoop-yarn-registry in the patch passed.
          -1 unit 45m 52s hadoop-yarn-server-resourcemanager in the patch failed.
          -1 unit 25m 14s hadoop-yarn-client in the patch failed.
          -1 unit 15m 59s hadoop-yarn-slider in the patch failed.
          -1 unit 15m 56s hadoop-yarn-slider-core in the patch failed.
          +1 unit 0m 26s hadoop-yarn-services-api in the patch passed.
          +1 asflicense 0m 42s The patch does not generate ASF License warnings.
          274m 28s



          Reason Tests
          FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core
            Increment of volatile field org.apache.hadoop.yarn.service.component.Component.currentContainerFailure in org.apache.hadoop.yarn.service.component.Component.updateMetrics(ContainerStatus) At Component.java:in org.apache.hadoop.yarn.service.component.Component.updateMetrics(ContainerStatus) At Component.java:[line 357]
            Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:[line 107]
            Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:[line 81]
            Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:[line 1966]
            Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:[line 1226]
            Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:[line 1194]
            Switch statement found in org.apache.slider.server.appmaster.state.AppState.incFailedContainers(RoleStatus, ContainerOutcome) where default case is missing At AppState.java:ContainerOutcome) where default case is missing At AppState.java:[lines 1022-1031]
          Failed junit tests hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
            hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
            hadoop.yarn.client.api.impl.TestNMClient
            hadoop.yarn.client.api.impl.TestNMClient
          Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMStoreCommands
            org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA
            org.apache.hadoop.yarn.service.TestYarnNativeServices
            org.apache.hadoop.yarn.service.TestYarnNativeServices



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue YARN-6903
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12881576/YARN-6903.yarn-native-services.08.patch
          Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc
          uname Linux c7be4b7ce378 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision yarn-native-services / f1a358e
          Default Java 1.8.0_144
          shellcheck v0.4.6
          findbugs v3.1.0-RC1
          javac https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt
          checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/whitespace-eol.txt
          whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/whitespace-tabs.txt
          findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt
          unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16871/testReport/
          modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/16871/console
          Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 114 new or modified test files.       yarn-native-services Compile Tests 0 mvndep 3m 8s Maven dependency ordering for branch +1 mvninstall 16m 15s yarn-native-services passed +1 compile 9m 46s yarn-native-services passed +1 checkstyle 1m 41s yarn-native-services passed +1 mvnsite 7m 30s yarn-native-services passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider +1 findbugs 5m 1s yarn-native-services passed +1 javadoc 3m 59s yarn-native-services passed       Patch Compile Tests 0 mvndep 0m 13s Maven dependency ordering for patch +1 mvninstall 6m 4s the patch passed +1 compile 5m 39s the patch passed +1 cc 5m 39s the patch passed -1 javac 5m 39s hadoop-yarn-project_hadoop-yarn generated 3 new + 133 unchanged - 5 fixed = 136 total (was 138) -0 checkstyle 1m 37s hadoop-yarn-project/hadoop-yarn: The patch generated 586 new + 1572 unchanged - 407 fixed = 2158 total (was 1979) +1 mvnsite 7m 10s the patch passed +1 shellcheck 0m 23s There were no new shellcheck issues. +1 shelldocs 0m 12s There were no new shelldocs issues. -1 whitespace 0m 1s The patch has 26 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply -1 whitespace 0m 2s The patch 1 line(s) with tabs. +1 xml 0m 7s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider -1 findbugs 1m 18s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core generated 7 new + 0 unchanged - 0 fixed = 7 total (was 0) -1 javadoc 1m 48s hadoop-yarn in the patch failed. -1 javadoc 0m 20s hadoop-yarn-slider in the patch failed. -1 javadoc 0m 19s hadoop-yarn-slider-core in the patch failed.       Other Tests -1 unit 76m 35s hadoop-yarn in the patch failed. +1 unit 3m 4s hadoop-yarn-common in the patch passed. +1 unit 1m 8s hadoop-yarn-registry in the patch passed. -1 unit 45m 52s hadoop-yarn-server-resourcemanager in the patch failed. -1 unit 25m 14s hadoop-yarn-client in the patch failed. -1 unit 15m 59s hadoop-yarn-slider in the patch failed. -1 unit 15m 56s hadoop-yarn-slider-core in the patch failed. +1 unit 0m 26s hadoop-yarn-services-api in the patch passed. +1 asflicense 0m 42s The patch does not generate ASF License warnings. 274m 28s Reason Tests FindBugs module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core   Increment of volatile field org.apache.hadoop.yarn.service.component.Component.currentContainerFailure in org.apache.hadoop.yarn.service.component.Component.updateMetrics(ContainerStatus) At Component.java:in org.apache.hadoop.yarn.service.component.Component.updateMetrics(ContainerStatus) At Component.java: [line 357]   Boxing/unboxing to parse a primitive org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java:org.apache.slider.api.resource.Resource.getMemoryMB() At Resource.java: [line 107]   Non-virtual method call in org.apache.slider.providers.AbstractProviderService.buildContainerLaunchContext(ContainerLauncher, Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java:Application, Container, ProviderRole, SliderFileSystem, RoleInstance) passes null for non-null parameter of org.apache.hadoop.yarn.service.provider.ProviderUtils.initCompTokensForSubstitute(ComponentInstance) At AbstractProviderService.java: [line 81]   Dead store to providerService in org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.onContainerStatusReceived(ContainerId, ContainerStatus) At SliderAppMaster.java: [line 1966]   Dead store to cid in org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java:org.apache.slider.server.appmaster.SliderAppMaster.unregisterComponent(RoleInstance) At SliderAppMaster.java: [line 1226]   Null passed for non-null parameter of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java:of org.apache.hadoop.yarn.service.timelineservice.ServiceTimelinePublisher.componentInstanceStarted(Container, ComponentInstance) in org.apache.slider.server.appmaster.SliderAppMaster.registerComponent(ContainerId, RoleInstance) At SliderAppMaster.java: [line 1194]   Switch statement found in org.apache.slider.server.appmaster.state.AppState.incFailedContainers(RoleStatus, ContainerOutcome) where default case is missing At AppState.java:ContainerOutcome) where default case is missing At AppState.java: [lines 1022-1031] Failed junit tests hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities   hadoop.yarn.client.api.impl.TestNMClient   hadoop.yarn.client.api.impl.TestNMClient Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMStoreCommands   org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA   org.apache.hadoop.yarn.service.TestYarnNativeServices   org.apache.hadoop.yarn.service.TestYarnNativeServices Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue YARN-6903 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12881576/YARN-6903.yarn-native-services.08.patch Optional Tests asflicense shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml cc uname Linux c7be4b7ce378 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision yarn-native-services / f1a358e Default Java 1.8.0_144 shellcheck v0.4.6 findbugs v3.1.0-RC1 javac https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/diff-compile-javac-hadoop-yarn-project_hadoop-yarn.txt checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/whitespace-eol.txt whitespace https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/whitespace-tabs.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/new-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.html javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt javadoc https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/16871/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-slider_hadoop-yarn-slider-core.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/16871/testReport/ modules C: hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-slider/hadoop-yarn-slider-core hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-services-api U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/16871/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          billie.rinaldi Billie Rinaldi added a comment -

          I have done some basic testing of this patch and I think it's in pretty good shape. The precommit build issues seem to be unrelated or in code that is going to be removed. I think we should go ahead and commit this and perform additional cleanup in follow on tickets.

          Show
          billie.rinaldi Billie Rinaldi added a comment - I have done some basic testing of this patch and I think it's in pretty good shape. The precommit build issues seem to be unrelated or in code that is going to be removed. I think we should go ahead and commit this and perform additional cleanup in follow on tickets.
          Hide
          jianhe Jian He added a comment -

          I'll fix the rest of the jenkins issues in a followup patch, as this patch is big enough.

          Show
          jianhe Jian He added a comment - I'll fix the rest of the jenkins issues in a followup patch, as this patch is big enough.
          Hide
          jianhe Jian He added a comment -

          The patch is committed in yarn-native-services branch. Thanks Billie for the reviews and testings !!

          Show
          jianhe Jian He added a comment - The patch is committed in yarn-native-services branch. Thanks Billie for the reviews and testings !!

            People

            • Assignee:
              jianhe Jian He
              Reporter:
              jianhe Jian He
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development