[TEZ-3834] TaskSchedulerManager NullPointerException during shutdown when failed to start

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.1
• Hadoop Flags: Reviewed
• Assignee: Jonathan Turner Eagles
• Reporter: Jonathan Turner Eagles
• Created: 14/Sep/17 20:31
• Updated: 05/Jan/18 00:17
• Resolved: 19/Sep/17 18:21

Description

NPE 1

2017-09-14 12:16:48,259 [ERROR] [main] |rm.TaskSchedulerManager|: Failed to do a clean initiateStop for Scheduler: [0:TezYarn]
java.lang.NullPointerException
	at org.apache.tez.dag.app.rm.TaskSchedulerManager.initiateStop(TaskSchedulerManager.java:696)
	at org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:2223)
	at org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2239)
	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
	at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
	at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:203)
	at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2707)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1936)
	at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2703)
	at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2508)

NPE 2

2017-09-14 12:16:48,610 [ERROR] [main] |rm.TaskSchedulerManager|: Error in TaskScheduler when checking if a scheduler has unregistered, scheduler=[0:TezYarn]
java.lang.NullPointerException
	at org.apache.tez.dag.app.rm.TaskSchedulerManager.hasUnregistered(TaskSchedulerManager.java:998)
	at org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:2252)
	at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
	at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
	at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:203)
	at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2707)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1936)
	at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2703)
	at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2508)

Issue Links

• is duplicated by: TEZ-3835 Failure during startup and shutdown caused DAGAppMaster to fail subsequent hive attempts