Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1751

New logical plan: PushDownForEachFlatten fail in UDF with unknown output schema

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.0
    • 0.8.0
    • impl
    • None
    • Reviewed

    Description

      The following script fail:

      a = load '1.txt' as (a0:chararray);
      b = load '2.txt' as (b0:chararray);
      c = foreach b generate flatten(STRSPLIT(b0)) as c0;
      d = join c by c0, a by a0;
      dump d;
      

      Error message:
      Caused by: java.lang.NullPointerException
      at org.apache.pig.newplan.logical.rules.PushDownForEachFlatten$PushDownForEachFlattenTransformer.getNonFlattenFieldUids(PushDownForEachFlatten.java:186)
      at org.apache.pig.newplan.logical.rules.PushDownForEachFlatten$PushDownForEachFlattenTransformer.check(PushDownForEachFlatten.java:101)
      at org.apache.pig.newplan.optimizer.PlanOptimizer.optimize(PlanOptimizer.java:108)
      ... 13 more

      Attachments

        1. PIG-1751-1.patch
          2 kB
          Daniel Dai

        Activity

          People

            daijy Daniel Dai
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: