Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
-
Ubuntu Desktop 16 LTE, jdk1.8.92 & Hadoop 2.7.2
-
ExpiredTokenRemover
Description
Hadoop/HDFS & Yarn processes exit (all jps deamons) and user is thrown out from session when it is running an MR job, after some interval (i.e. after few jobs completed successfully).
Error in log file: 2016-07-23 17:56:16,258 ERROR org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
Log file: /usr/local/hadoop/logs/yarn-hduser-resourcemanager-KMUbLptp.log
2016-07-23 17:56:14,044 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1469316920580_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING
2016-07-23 17:56:14,663 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate of application :application_1469316920580_0007
2016-07-23 17:56:16,201 ERROR org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: RECEIVED SIGNAL 15: SIGTERM
2016-07-23 17:56:16,258 ERROR org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
2016-07-23 17:56:16,259 INFO org.mortbay.log: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8088
2016-07-23 17:56:16,284 ERROR org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: RECEIVED SIGNAL 15: SIGTERM
2016-07-23 17:56:16,360 INFO org.apache.hadoop.ipc.Server: Stopping server on 8032
2016-07-23 17:56:16,361 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8032
2016-07-23 17:56:16,361 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2016-07-23 17:56:16,362 INFO org.apache.hadoop.ipc.Server: Stopping server on 8033
This error is happens only after below terminal output entry :
16/07/23 17:56:13 INFO mapreduce.Job: map 0% reduce 0%
Environment:
Ubuntu Desktop 16 LTE, jdk1.8.92 & Hadoop 2.7.2
Steps to reproduce:
(1)login (on terminal) using dedicated user hduser (a sudo user) using command: su hduser
(2)start hadoop daemons using commands: start-dfs.sh & start-yarn.sh
(3)I can see all processes
(4)Few MR jobs completed successfully. Can try submit same job after about 10-15 min.
(5)This user is thrown out & land in regular desktop user session.
I think it could be some timeout, it works normally again if I restart my machine & start over again. I get same error if I follow the same steps on the same terminal session.
I would appreciate if somebody has encountered this issue.