[YARN-7036] [ATSv2] : NPE for recovered finished applications in NM during upgrade

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Assignee: Unassigned
• Reporter: Rohith Sharma K S
• Created: 17/Aug/17 10:30
• Updated: 21/Aug/17 06:53
• Resolved: 21/Aug/17 06:53

Description

It is seen that NPE is logged in NM logs when finished applications are recovered during upgrade. But I do not see any impact for functionality of NM.
Trace is

017-08-17 10:22:46,137 WARN  service.AbstractService (ServiceOperations.java:stopQuietly(82)) - When stopping the service org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl : java.lang.NullPointerException
java.lang.NullPointerException
        at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl$TimelineEntityDispatcher.stop(TimelineV2ClientImpl.java:471)
        at org.apache.hadoop.yarn.client.api.impl.TimelineV2ClientImpl.serviceStop(TimelineV2ClientImpl.java:130)
        at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
        at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
        at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:171)
        at org.apache.hadoop.yarn.server.nodemanager.timelineservice.NMTimelinePublisher$1.run(NMTimelinePublisher.java:415)
        at org.apache.hadoop.yarn.server.nodemanager.timelineservice.NMTimelinePublisher$1.run(NMTimelinePublisher.java:410)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1965)
        at org.apache.hadoop.yarn.server.nodemanager.timelineservice.NMTimelinePublisher.createTimelineClient(NMTimelinePublisher.java:410)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationImpl.<init>(ApplicationImpl.java:125)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.recoverApplication(ContainerManagerImpl.java:401)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.recover(ContainerManagerImpl.java:353)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:307)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:408)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:790)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:851)