[YARN-9447] RM Crashes with NPE at TimelineServiceV2Publisher.putEntity

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 3.2.0
• Component/s: ATSv2
• Assignee: Prabhu Joseph
• Reporter: Prabhu Joseph
• Created: 05/Apr/19 15:19
• Updated: 23/Oct/19 16:15
• Resolved: 15/Apr/19 05:56

Description

ResourceManager crashes with NullPointerException when TimelineServiceV2Publisher does putEntity after the timeline collector service for application is removed. This happened when killing a mapreduce job.

2019-04-05 14:53:24,728 INFO org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorManager: The collector service for application_1553788280931_0013 was removed
2019-04-05 14:53:24,734 FATAL org.apache.hadoop.yarn.event.AsyncDispatcher: Error in dispatcher thread
java.lang.NullPointerException
        at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher.putEntity(TimelineServiceV2Publisher.java:461)
        at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher.access$100(TimelineServiceV2Publisher.java:73)
        at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler.handle(TimelineServiceV2Publisher.java:496)
        at org.apache.hadoop.yarn.server.resourcemanager.metrics.TimelineServiceV2Publisher$TimelineV2EventHandler.handle(TimelineServiceV2Publisher.java:485)
        at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:197)
        at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:126)
        at java.lang.Thread.run(Thread.java:748)
2019-04-05 14:53:24,743 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Exiting, bbye..
2019-04-05 14:53:24,758 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AbstractYarnScheduler: Container container_e30_1553788280931_0013_01_000001 completed with event FINISHED, but corresponding RMContainer doesn't exist.

Issue Links

• duplicates: YARN-6695 Race condition in RM for publishing container events vs appFinished events causes NPE