Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-285 Support Lineage information capture
  3. FALCON-579

Lineage breaks if feed.xml doesn't have the date pattern in feed path location

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.6
    • None
    • None

    Description

      Lineage breaks if feed.xml doesn't have the date pattern in feed path.

      Stack trace:
      2014-08-07 18:00:24,385 INFO  - [ActiveMQ Session Task:] ~ Computing feed instance for : name=input-feed, path= hdfs://master.hortonworks.com:8020/landing/data, in cluster: KLSS (InstanceRelationshipGraphBuilder:173)
      2014-08-07 18:00:24,389 INFO  - [ActiveMQ Session Task:] ~ Error in onMessage for subscriber of topic: FALCON.ENTITY.TOPIC (FalconTopicSubscriber:136)
      java.lang.RuntimeException: java.text.ParseException: Unparseable date: ""
              at org.apache.falcon.entity.v0.SchemaHelper.formatDateUTCToISO8601(SchemaHelper.java:68)
              at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFileSystemFeedInstanceName(InstanceRelationshipGraphBuilder.java:230)
              at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:203)
              at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:175)
              at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addInputFeedInstances(InstanceRelationshipGraphBuilder.java:163)
              at org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceAdded(MetadataMappingService.java:284)
              at org.apache.falcon.metadata.MetadataMappingService.onSuccessfulWorkflowCompletion(MetadataMappingService.java:265)
              at org.apache.falcon.service.FalconTopicSubscriber.notifyMetadataMappingService(FalconTopicSubscriber.java:144)
              at org.apache.falcon.service.FalconTopicSubscriber.onMessage(FalconTopicSubscriber.java:129)
              at org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
              at org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
              at org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
              at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
              at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:744)
      Caused by: java.text.ParseException: Unparseable date: ""
              at java.text.DateFormat.parse(DateFormat.java:357)
              at org.apache.falcon.entity.v0.SchemaHelper.formatDateUTCToISO8601(SchemaHelper.java:66)
      

      Attachments

        1. feed.xml
          0.6 kB
          Sowmya Ramesh
        2. FALCON-579.patch
          5 kB
          Sowmya Ramesh
        3. FALCON-579.v1.patch
          10 kB
          Sowmya Ramesh
        4. FALCON-579.v2.patch
          10 kB
          Sowmya Ramesh

        Activity

          People

            sowmyaramesh Sowmya Ramesh
            sowmyaramesh Sowmya Ramesh
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: