Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4167

NPE on RMActiveServices#serviceStop when store is null

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Configure yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs mismatching with yarn.nm.liveness-monitor.expiry-interval-ms

      On startup NPE is thrown on RMActiveServices#serviceStop

      2015-09-16 12:23:29,504 INFO org.apache.hadoop.service.AbstractService: Service RMActiveServices failed in state INITED; cause: java.lang.IllegalArgumentException: yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs should be more than 3 X yarn.nm.liveness-monitor.expiry-interval-ms
      java.lang.IllegalArgumentException: yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs should be more than 3 X yarn.nm.liveness-monitor.expiry-interval-ms
       at org.apache.hadoop.yarn.server.resourcemanager.security.RMContainerTokenSecretManager.<init>(RMContainerTokenSecretManager.java:82)
       at org.apache.hadoop.yarn.server.resourcemanager.RMSecretManagerService.createContainerTokenSecretManager(RMSecretManagerService.java:109)
       at org.apache.hadoop.yarn.server.resourcemanager.RMSecretManagerService.<init>(RMSecretManagerService.java:57)
       at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createRMSecretManagerService(ResourceManager.java:1111)
       at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:423)
       at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
       at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:963)
       at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:256)
       at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
       at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1193)
      2015-09-16 12:23:29,507 ERROR org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error closing store.
      java.lang.NullPointerException
       at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceStop(ResourceManager.java:608)
       at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
       at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
       at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
       at org.apache.hadoop.service.AbstractService.init(AbstractService.java:171)
       at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:963)
       at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:256)
       at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
       at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1193
      

      Impact Area: RM failover with wrong configuration

      1. 0001-YARN-4167.patch
        1 kB
        Bibin A Chundatt
      2. 0001-YARN-4167.patch
        1 kB
        Bibin A Chundatt
      3. 0002-YARN-4167.patch
        1 kB
        Bibin A Chundatt

        Issue Links

          Activity

          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Its an improvement .

          Show
          bibinchundatt Bibin A Chundatt added a comment - Its an improvement .
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Attaching patch for the same . Please review

          Show
          bibinchundatt Bibin A Chundatt added a comment - Attaching patch for the same . Please review
          Hide
          rohithsharma Rohith Sharma K S added a comment -

          +1 lgtm.. pending jenkins

          Show
          rohithsharma Rohith Sharma K S added a comment - +1 lgtm.. pending jenkins
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Uploading same patch again to trigger Jenkins

          Show
          bibinchundatt Bibin A Chundatt added a comment - Uploading same patch again to trigger Jenkins
          Hide
          bibinchundatt Bibin A Chundatt added a comment -

          Renamed patch and uploaded the same again to trigger Jenkins

          Show
          bibinchundatt Bibin A Chundatt added a comment - Renamed patch and uploaded the same again to trigger Jenkins
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 16m 56s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          +1 javac 7m 51s There were no new javac warning messages.
          +1 javadoc 10m 12s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 0m 49s There were no new checkstyle issues.
          +1 whitespace 0m 0s The patch has no lines that end in whitespace.
          +1 install 1m 30s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 1m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 yarn tests 58m 56s Tests passed in hadoop-yarn-server-resourcemanager.
              98m 43s  



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12761264/0002-YARN-4167.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / e3ace31
          hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9217/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt
          Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9217/testReport/
          Java 1.7.0_55
          uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-YARN-Build/9217/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 16m 56s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 7m 51s There were no new javac warning messages. +1 javadoc 10m 12s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 49s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 30s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 1m 29s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 yarn tests 58m 56s Tests passed in hadoop-yarn-server-resourcemanager.     98m 43s   Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12761264/0002-YARN-4167.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / e3ace31 hadoop-yarn-server-resourcemanager test log https://builds.apache.org/job/PreCommit-YARN-Build/9217/artifact/patchprocess/testrun_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/9217/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-YARN-Build/9217/console This message was automatically generated.
          Hide
          rohithsharma Rohith Sharma K S added a comment -

          Committed to branch-2/trunk.. Thanks Bibin A Chundatt!!

          Show
          rohithsharma Rohith Sharma K S added a comment - Committed to branch-2/trunk.. Thanks Bibin A Chundatt !!
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8494 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8494/)
          YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8494 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8494/ ) YARN-4167 . NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #418 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/418/)
          YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #418 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/418/ ) YARN-4167 . NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #426 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/426/)
          YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)

          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          • hadoop-yarn-project/CHANGES.txt
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #426 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/426/ ) YARN-4167 . NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java hadoop-yarn-project/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Yarn-trunk #1158 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1158/)
          YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #1158 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1158/ ) YARN-4167 . NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2337 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2337/)
          YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2337 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2337/ ) YARN-4167 . NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #399 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/399/)
          YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #399 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/399/ ) YARN-4167 . NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2364 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2364/)
          YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9)

          • hadoop-yarn-project/CHANGES.txt
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2364 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2364/ ) YARN-4167 . NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks) (rohithsharmaks: rev c9cb6a5960ad335a3ee93a6ee219eae5aad372f9) hadoop-yarn-project/CHANGES.txt hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceManager.java

            People

            • Assignee:
              bibinchundatt Bibin A Chundatt
              Reporter:
              bibinchundatt Bibin A Chundatt
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development