Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-192 Release falcon 0.4 umbrella
  3. FALCON-204

Process mapper generates params assuming table input and output as names literally

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 0.4
    • 0.4
    • process
    • None

    Description

      org.apache.falcon.converter.OozieProcessMapper generates input params assuming input as the name rather than using user provided name which results in coordinator submission failure. Same is true of output as well.

      This is true only if input and output are of table storage but not file system.

      props.put(prefix + "_partition_filter_pig", "${coord:dataInPartitionFilter('input', 'pig')}");   
      props.put(prefix + "_partition_filter_hive", "${coord:dataInPartitionFilter('input', 'hive')}"); 
      props.put(prefix + "_partition_filter_java", "${coord:dataInPartitionFilter('input', 'java')}"); 
      
      props.put(prefix + "_dataout_partitions", "${coord:dataOutPartitions('output')}");
      

      Attachments

        1. FALCON-204.patch
          4 kB
          Venkatesh Seetharam

        Issue Links

          Activity

            People

              svenkat Venkatesh Seetharam
              svenkat Venkatesh Seetharam
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: