Details
-
Type:
Bug
-
Status: Closed
-
Priority:
Minor
-
Resolution: Fixed
-
Affects Version/s: 0.23.0, 2.0.0-alpha
-
Fix Version/s: 2.0.0-alpha
-
Component/s: resourcemanager
-
Labels:
-
Environment:
OS/X w/ java6
-
Target Version/s:
Description
bringing up a resource manager failed; shutdown triggered an NPE
Issue Links
- relates to
-
YARN-117
Enhance YARN service model
-
- Closed
-
Activity
- All
- Comments
- Work Log
- History
- Activity
- Transitions
Integrated in Hadoop-Mapreduce-0.23-Build #228 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/228/)
MAPREDUCE-3431 (Revision 1301502)
Result = FAILURE
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301502
Files :
- /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
- /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/security/DelegationTokenRenewer.java
- /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewerLifecycle.java
Integrated in Hadoop-Hdfs-0.23-Build #200 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/200/)
MAPREDUCE-3431 (Revision 1301502)
Result = SUCCESS
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301502
Files :
- /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
- /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/security/DelegationTokenRenewer.java
- /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewerLifecycle.java
Integrated in Hadoop-Hdfs-trunk #987 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/987/)
MAPREDUCE-3431 (Revision 1301500)
MAPREDUCE-3431 (Revision 1301496)
Result = SUCCESS
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301500
Files :
- /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301496
Files :
- /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/security/DelegationTokenRenewer.java
- /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewerLifecycle.java
Integrated in Hadoop-Mapreduce-trunk-Commit #1895 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1895/)
MAPREDUCE-3431 (Revision 1301500)
MAPREDUCE-3431 (Revision 1301496)
Result = ABORTED
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301500
Files :
- /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301496
Files :
- /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/security/DelegationTokenRenewer.java
- /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewerLifecycle.java
Integrated in Hadoop-Mapreduce-0.23-Commit #699 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/699/)
MAPREDUCE-3431 (Revision 1301502)
Result = ABORTED
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301502
Files :
- /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
- /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/security/DelegationTokenRenewer.java
- /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewerLifecycle.java
Integrated in Hadoop-Common-trunk-Commit #1887 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1887/)
MAPREDUCE-3431 (Revision 1301500)
MAPREDUCE-3431 (Revision 1301496)
Result = SUCCESS
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301500
Files :
- /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301496
Files :
- /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/security/DelegationTokenRenewer.java
- /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewerLifecycle.java
voting for this myself, +1, it's a trivial robustness tweak to shutdowns with tests
test failures is caused by MAPREDUCE-4010
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12518458/MAPREDUCE-3431.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 2 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.mapred.TestWritableJobConf
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2057//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2057//console
This message is automatically generated.
test + fix; simple example of brittle shutdown policy
root cause
the root cause of this is the service stop() method assumes the service started up correctly, and hence that all member fields are non-null. Each field should be assessed for null-ness before use, and set to null afterwards, to stop re-entrant calls. All yarn services will need reviewing. Testing is hard as it's tricky to generate all code-paths needed to stress every action in the stop() method
full exec log
homemac:current slo$ yarn resourcemanager /Library/Java/Home/bin/java -Dproc_resourcemanager -Xmx1000m -Dhadoop.log.dir=/Users/slo/Hadoop/versions/current/bin/../logs -Dyarn.log.dir=/Users/slo/Hadoop/versions/current/bin/../logs -Dhadoop.log.file=yarn.log -Dyarn.log.file=yarn.log -Dyarn.home.dir= -Dyarn.id.str= -Dhadoop.root.logger=INFO,console -Dyarn.root.logger=INFO,console -Dyarn.policy.file=hadoop-policy.xml -Dhadoop.log.dir=/Users/slo/Hadoop/versions/current/bin/../logs -Dyarn.log.dir=/Users/slo/Hadoop/versions/current/bin/../logs -Dhadoop.log.file=yarn.log -Dyarn.log.file=yarn.log -Dyarn.home.dir=/Users/slo/Hadoop/versions/current/bin/.. -Dhadoop.root.logger=INFO,console -Dyarn.root.logger=INFO,console -classpath /Users/slo/Hadoop/versions/current/etc/hadoop/:/Users/slo/Hadoop/versions/current/conf::/Library/Java/Home/lib/tools.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/*:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/*:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/*:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/*:/Users/slo/Hadoop/versions/current/bin/../modules/*:/Users/slo/Hadoop/versions/current/bin/../lib/*:/Users/slo/Hadoop/versions/current/conf/rm-config/log4j.properties org.apache.hadoop.yarn.server.resourcemanager.ResourceManager 11/11/18 16:21:57 INFO resourcemanager.ResourceManager: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting ResourceManager STARTUP_MSG: host = homemac/192.168.1.88 STARTUP_MSG: args = [] STARTUP_MSG: version = 0.23.0 STARTUP_MSG: classpath = /Users/slo/Hadoop/versions/current/etc/hadoop/:/Users/slo/Hadoop/versions/current/conf::/Library/Java/Home/lib/tools.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/hadoop-common-0.23.0-sources.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/hadoop-common-0.23.0-test-sources.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/hadoop-common-0.23.0-tests.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/hadoop-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/activation-1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/asm-3.2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/aspectjrt-1.6.5.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/avro-1.5.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/avro-ipc-1.5.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-cli-1.2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-codec-1.4.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-collections-3.2.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-configuration-1.6.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-digester-1.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-el-1.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-httpclient-3.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-lang-2.5.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-logging-1.1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-logging-api-1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-math-2.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/commons-net-1.4.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/core-3.1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/guava-r09.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-auth-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-mapreduce-client-app-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-mapreduce-client-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-mapreduce-client-core-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-mapreduce-client-jobclient-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-yarn-api-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-yarn-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hadoop-yarn-server-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/hsqldb-1.8.0.7.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jackson-core-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jackson-jaxrs-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jackson-mapper-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jackson-xc-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jersey-core-1.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jersey-json-1.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jersey-server-1.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jets3t-0.6.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jettison-1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jetty-6.1.26.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jetty-util-6.1.26.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/jsp-api-2.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/kfs-0.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/log4j-1.2.15.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/netty-3.2.4.Final.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/oro-2.0.8.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/paranamer-2.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/servlet-api-2.5.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/slf4j-api-1.5.11.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/slf4j-log4j12-1.5.11.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/snappy-java-1.0.3.2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/stax-api-1.0-2.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/stax-api-1.0.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/velocity-1.7.jar:/Users/slo/Hadoop/versions/current/share/hadoop/common/lib/xmlenc-0.52.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/hadoop-hdfs-0.23.0-sources.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/hadoop-hdfs-0.23.0-test-sources.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/hadoop-hdfs-0.23.0-tests.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/hadoop-hdfs-0.23.0.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/avro-1.5.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/commons-daemon-1.0.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/jackson-core-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/jackson-mapper-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/log4j-1.2.15.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/paranamer-2.3.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/protobuf-java-2.4.0a.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/slf4j-api-1.5.11.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/slf4j-log4j12-1.5.11.jar:/Users/slo/Hadoop/versions/current/share/hadoop/hdfs/lib/snappy-java-1.0.3.2.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-app-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-core-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-hs-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-jobclient-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-mapreduce-client-shuffle-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-api-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-applications-distributedshell-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-server-common-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-server-nodemanager-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-server-resourcemanager-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-server-web-proxy-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../modules/hadoop-yarn-site-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/aopalliance-1.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/avro-1.5.3.jar:/Users/slo/Hadoop/versions/current/bin/../lib/clover-3.0.2.jar:/Users/slo/Hadoop/versions/current/bin/../lib/commons-daemon-1.0.3.jar:/Users/slo/Hadoop/versions/current/bin/../lib/commons-io-2.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/commons-logging-1.1.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/guice-2.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/guice-servlet-2.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/hadoop-annotations-0.23.0.jar:/Users/slo/Hadoop/versions/current/bin/../lib/jackson-core-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/jackson-mapper-asl-1.7.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/jdiff-1.0.9.jar:/Users/slo/Hadoop/versions/current/bin/../lib/junit-4.8.2.jar:/Users/slo/Hadoop/versions/current/bin/../lib/log4j-1.2.15.jar:/Users/slo/Hadoop/versions/current/bin/../lib/netty-3.2.3.Final.jar:/Users/slo/Hadoop/versions/current/bin/../lib/paranamer-2.3.jar:/Users/slo/Hadoop/versions/current/bin/../lib/protobuf-java-2.4.0a.jar:/Users/slo/Hadoop/versions/current/bin/../lib/slf4j-api-1.6.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/slf4j-log4j12-1.6.1.jar:/Users/slo/Hadoop/versions/current/bin/../lib/snappy-java-1.0.3.2.jar:/Users/slo/Hadoop/versions/current/conf/rm-config/log4j.properties STARTUP_MSG: build = git://devadm900.cc1.ygridcore.net/grid/0/dev/acm/hadoop-trunk/hadoop-common-project/hadoop-common -r d4fee83ec1462ab9824add6449320617caa7c605; compiled by 'hortonmu' on Thu Nov 3 08:59:12 UTC 2011 ************************************************************/ SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/Users/slo/Java/Hadoop/versions/hadoop-0.23.0/share/hadoop/common/lib/slf4j-log4j12-1.5.11.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/Users/slo/Java/Hadoop/versions/hadoop-0.23.0/share/hadoop/hdfs/lib/slf4j-log4j12-1.5.11.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/Users/slo/Java/Hadoop/versions/hadoop-0.23.0/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 11/11/18 16:21:59 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher 11/11/18 16:21:59 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher 11/11/18 16:21:59 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher 11/11/18 16:21:59 INFO event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher 11/11/18 16:21:59 FATAL resourcemanager.ResourceManager: Error starting ResourceManager java.lang.IllegalArgumentException: Invalid attribute value for hadoop.security.authentication of ${SECURITY_TYPE} at org.apache.hadoop.security.UserGroupInformation.initUGI(UserGroupInformation.java:215) at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:194) at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:185) at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:264) at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:478) at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:461) at org.apache.hadoop.yarn.security.AdminACLsManager.<init>(AdminACLsManager.java:68) at org.apache.hadoop.yarn.server.security.ApplicationACLsManager.<init>(ApplicationACLsManager.java:51) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.init(ResourceManager.java:190) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:545) 11/11/18 16:21:59 INFO resourcemanager.ResourceManager: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down ResourceManager at homemac/192.168.1.88 ************************************************************/ 11/11/18 16:21:59 INFO service.CompositeService: Error stopping org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer java.lang.NullPointerException at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer.stop(DelegationTokenRenewer.java:88) at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95) at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.stop(ResourceManager.java:470) at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:119)
stack
java.lang.NullPointerException at org.apache.hadoop.yarn.server.resourcemanager.security.DelegationTokenRenewer.stop(DelegationTokenRenewer.java:88) at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:95) at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:85) at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.stop(ResourceManager.java:470) at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:119)
Integrated in Hadoop-Mapreduce-trunk #1022 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1022/)
MAPREDUCE-3431(Revision 1301500)MAPREDUCE-3431(Revision 1301496)Result = SUCCESS
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301500
Files :
stevel : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301496
Files :