[FALCON-1420] NPE in MetadataMappingService when adding process instance executed

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.7
• Assignee: Unassigned
• Reporter: Sowmya Ramesh
• Created: 29/Aug/15 00:06
• Updated: 31/Aug/15 04:34
• Resolved: 31/Aug/15 04:34

Description

FALCON-1091 changed value of property WorkflowExecutionArgs.OUTPUT_FEED_NAMES.getName() "NONE" to "IGNORE" in ProcessExecutionCoordinatorBuilder.initializeOutputPaths which has introduced the bug. For a process if there are no output feed MetadataMappingService should not go ahead to add output feed instance.

Message:
2015-08-28 23:43:48,798 INFO - [ActiveMQ Session Task:] ~ Adding lineage for context WorkflowExecutionContext{{brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, operation=GENERATE, contextType=POST_PROCESSING, logDir=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00//, falconInputFeeds=NONE, cluster=primaryCluster, brokerTTL=4320, entityType=PROCESS, workflowEngineUrl=http://sandbox.hortonworks.com:11000/oozie/, brokerUrl=tcp://sandbox.hortonworks.com:61616, entityName=replication-monthly, userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, subflowId=0000033-150727232450793-oozie-oozi-W@user-action, falconInPaths=IGNORE, userJMSNotificationEnabled=true, timeStamp=2015-08-28-23-39, feedInstancePaths=IGNORE, userWorkflowVersion=1.0, workflowUser=ambari-qa, workflowId=0000033-150727232450793-oozie-oozi-W, userBrokerUrl=tcp://sandbox.hortonworks.com:61616?daemon=true, status=SUCCEEDED, contextFile=hdfs://sandbox.hortonworks.com:8020/apps/falcon/primaryCluster/staging/falcon/workflows/process/replication-monthly/logs/job-2015-08-28-23-00/replication-monthly-wf-post-exec-context.json, userWorkflowName=hdfs-dr-workflow, nominalTime=2015-08-28-23-00, feedNames=IGNORE, runId=0, userWorkflowEngine=oozie}} (MetadataMappingService:261)

Exception:

2015-08-28 23:43:49,607 ERROR - [ActiveMQ Session Task:] ~ Error in listener org.apache.falcon.metadata.MetadataMappingService (WorkflowJobEndNotificationService:104)
org.apache.falcon.FalconException: java.lang.RuntimeException: java.lang.NullPointerException
	at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:274)
	at org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
	at org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:138)
	at org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:110)
	at org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
	at org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
	at org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
	at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
	at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
	at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
	at com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
	at com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
	at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:263)
	... 11 more
Caused by: java.lang.NullPointerException
	at org.apache.falcon.entity.FeedHelper.getCluster(FeedHelper.java:80)
	at org.apache.falcon.entity.FeedHelper.getStorageType(FeedHelper.java:235)
	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:280)
	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:245)
	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addOutputFeedInstances(InstanceRelationshipGraphBuilder.java:151)
	at org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceExecuted(MetadataMappingService.java:304)
	at org.apache.falcon.metadata.MetadataMappingService.onSuccessfulExecution(MetadataMappingService.java:282)
	at org.apache.falcon.metadata.MetadataMappingService.access$100(MetadataMappingService.java:53)
	at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:267)
	at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:264)
	at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
	... 14 more

Issue Links

• is duplicated by: FALCON-1401 MetadataMappingService fails to add an edge for a process instance