Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-1482

Adding lineage for Hcat evicted instance throws "org.apache.falcon.FalconException: java.net.URISyntaxException"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.7
    • None
    • retention
    • None

    Description

      Message:

      2015-09-22 23:28:31,005 INFO  - [ActiveMQ Session Task:] ~ Adding lineage for context WorkflowExecutionContext{{timeStamp=2015-09-22-23-27, subflowId=0000566-150922060853958-oozie-oozi-W, userWorkflowName=eviction-policy, brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, cluster=Aa2bd2902-92ff007c, feedNames=Aa2bd2902-71d5d463, contextFile=hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/fs/falcon/workflows/feed/Aa2bd2902-71d5d463/logs/job-2015-09-22-23-27/context/Aa2bd2902-71d5d463-wf-post-exec-context.json, contextType=POST_PROCESSING, workflowUser=hrt_qa, brokerUrl=tcp://os-r7-rtwmbs-falcon-2-9.novalocal:61616, workflowEngineUrl=http://os-r7-rtwmbs-falcon-2-14.novalocal:11000/oozie/, userBrokerUrl=tcp://os-r7-rtwmbs-falcon-2-9.novalocal:61616?daemon=true, userJMSNotificationEnabled=true, status=SUCCEEDED, entityType=FEED, nominalTime=2015-09-22-23-27, falconInputFeeds=Aa2bd2902-71d5d463, falconInPaths=IGNORE, userWorkflowVersion=0.6.1.2.3.2.0-2891-re70ab04fdf493a787d049a85953d190c0a0e5538, runId=0, workflowId=0000566-150922060853958-oozie-oozi-W, feedInstancePaths=hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009, brokerTTL=4320, logDir=hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/fs/falcon/workflows/feed/Aa2bd2902-71d5d463/logs/job-2015-09-22-23-27//, entityName=Aa2bd2902-71d5d463, operation=DELETE, userWorkflowEngine=falcon, 

      userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory}} (MetadataMappingService:270)
2015-09-22 23:28:31,006 INFO  - [ActiveMQ Session Task:] ~ Adding evicted feed instance: 2015-09-22T23:27Z (MetadataMappingService:323)
2015-09-22 23:28:31,006 INFO  - [ActiveMQ Session Task:] ~ Recording lineage for evicted instances hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009 (InstanceRelationshipGraphBuilder:230)
2015-09-22 23:28:31,006 INFO  - [ActiveMQ Session Task:] ~ Computing feed instance for : name= Aa2bd2902-71d5d463, path=hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009, in cluster: Aa2bd2902-92ff007c (InstanceRelationshipGraphBuilder:237)
2015-09-22 23:28:31,025 INFO  - [ActiveMQ Session Task:] ~ Adding evicted feed instance: 2015-09-22T23:27Z (MetadataMappingService:323)
2015-09-22 23:28:31,025 INFO  - [ActiveMQ Session Task:] ~ Recording lineage for evicted instances hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009 (InstanceRelationshipGraphBuilder:230)
2015-09-22 23:28:31,025 INFO  - [ActiveMQ Session Task:] ~ Computing feed instance for : name= Aa2bd2902-71d5d463, path=hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009, in cluster: Aa2bd2902-92ff007c (InstanceRelationshipGraphBuilder:237)
2015-09-22 23:28:31,050 INFO  - [ActiveMQ Session Task:] ~ Adding evicted feed instance: 2015-09-22T23:27Z (MetadataMappingService:323)
2015-09-22 23:28:31,050 INFO  - [ActiveMQ Session Task:] ~ Recording lineage for evicted instances hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009 (InstanceRelationshipGraphBuilder:230)
2015-09-22 23:28:31,050 INFO  - [ActiveMQ Session Task:] ~ Computing feed instance for : name= Aa2bd2902-71d5d463, path=hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009, in cluster: Aa2bd2902-92ff007c (InstanceRelationshipGraphBuilder:237)
2015-09-22 23:28:31,050 ERROR - [ActiveMQ Session Task:] ~ Error in listener org.apache.falcon.metadata.MetadataMappingService (WorkflowJobEndNotificationService:104)
org.apache.falcon.FalconException: java.lang.RuntimeException: org.apache.falcon.FalconException: java.net.URISyntaxException: URI path is not in expected format: database:table: hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009
	at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:283)
	at org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
	at org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:138)
	at org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:110)
	at org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
	at org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
	at org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
	at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
	at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: org.apache.falcon.FalconException: java.net.URISyntaxException: URI path is not in expected format: database:table: hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009
	at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)
	at com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)
	at com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)
	at org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:272)
	... 11 more
Caused by: org.apache.falcon.FalconException: java.net.URISyntaxException: URI path is not in expected format: database:table: hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009
	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:305)
	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addEvictedInstance(InstanceRelationshipGraphBuilder.java:239)
	at org.apache.falcon.metadata.MetadataMappingService.onFeedInstanceEvicted(MetadataMappingService.java:324)
	at org.apache.falcon.metadata.MetadataMappingService.onSuccessfulExecution(MetadataMappingService.java:297)
	at org.apache.falcon.metadata.MetadataMappingService.access$100(MetadataMappingService.java:53)
	at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:276)
	at org.apache.falcon.metadata.MetadataMappingService$3.execute(MetadataMappingService.java:273)
	at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)
	... 14 more
Caused by: java.net.URISyntaxException: URI path is not in expected format: database:table: hdfs://os-r7-rtwmbs-falcon-2-13.novalocal:8020/tmp/falcon-regression/HCatRetentionTest/2009
	at org.apache.falcon.entity.CatalogStorage.parseUriTemplate(CatalogStorage.java:201)
	at org.apache.falcon.entity.CatalogStorage.<init>(CatalogStorage.java:189)
	at org.apache.falcon.entity.FeedHelper.createStorage(FeedHelper.java:184)
	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getTableFeedInstanceName(InstanceRelationshipGraphBuilder.java:311)
	at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:300)
	... 21 more

      Attachments

        Activity

          People

            Unassigned Unassigned
            sowmyaramesh Sowmya Ramesh
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: