[YARN-8350] NPE in service AM related to placement policy

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 3.2.0, 3.1.1
• Component/s: yarn-native-services
• Target Version/s: 3.1.1
• Assignee: Gour Saha
• Reporter: Billie Rinaldi
• Created: 24/May/18 00:17
• Updated: 31/May/18 00:55
• Resolved: 30/May/18 20:41

Description

It seems like this NPE is happening in a service with more than one component when one component has a placement policy and the other does not. It causes the AM to crash.

java.lang.NullPointerException
        at org.apache.hadoop.yarn.service.component.Component.requestContainers(Component.java:644)
        at org.apache.hadoop.yarn.service.component.Component$FlexComponentTransition.transition(Component.java:310)
        at org.apache.hadoop.yarn.service.component.Component$FlexComponentTransition.transition(Component.java:293)
        at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
        at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
        at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46)
        at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487)
        at org.apache.hadoop.yarn.service.component.Component.handle(Component.java:919)
        at org.apache.hadoop.yarn.service.ServiceScheduler.serviceStart(ServiceScheduler.java:344)
        at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
        at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
        at org.apache.hadoop.yarn.service.ServiceMaster.lambda$serviceStart$0(ServiceMaster.java:253)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682)
        at org.apache.hadoop.yarn.service.ServiceMaster.serviceStart(ServiceMaster.java:251)
        at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
        at org.apache.hadoop.yarn.service.ServiceMaster.main(ServiceMaster.java:317)

Issue Links

• is related to: YARN-8367 Fix NPE in SingleConstraintAppPlacementAllocator when placement constraint in SchedulingRequest is null