Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-285 Support Lineage information capture
  3. FALCON-360

Lineage recording fails with NPE for processes with >1 inputs

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.5
    • 0.5
    • None
    • None

    Description

      There is a split brain problem in org.apache.falcon.converter.OozieProcessMapper. The inputs use '#' as a separator but outputs use ',' as a separator for feed names and instance paths.

      org.apache.falcon.converter.OozieProcessMapper#initializeInputPaths

              props.put("falconInputFeeds", join(inputFeeds.iterator(), '#'));
              props.put("falconInPaths", join(inputPaths.iterator(), '#'));
      

      org.apache.falcon.converter.OozieProcessMapper#initializeOutputPaths

              // Output feed name and path for parent workflow
              props.put(ARG.feedNames.getPropName(), join(outputFeeds.iterator(), ','));
              props.put(ARG.feedInstancePaths.getPropName(), join(outputPaths.iterator(), ','));
      

      Attachments

        1. FALCON-360.patch
          3 kB
          Venkatesh Seetharam

        Activity

          People

            svenkat Venkatesh Seetharam
            svenkat Venkatesh Seetharam
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: