Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3657

New partition filter extractor fails with NPE

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.1, 0.13.0
    • impl
    • None

    Description

      To reproduce the issue, try a filter expression as follows-

      b = FILTER a BY partition_column < x OR (partition_column == y AND non-partition_column == z); 
      

      Pig fails with NPE, and the stack trace is something like this-

      Caused by: java.lang.NullPointerException
          at org.apache.pig.newplan.FilterExtractor.checkPushDown(FilterExtractor.java:252)
          at org.apache.pig.newplan.FilterExtractor.visit(FilterExtractor.java:115)
          at org.apache.pig.newplan.logical.rules.PartitionFilterOptimizer$PartitionFilterPushDownTransformer.transform(PartitionFilterOptimizer.java:150)
          at org.apache.pig.newplan.optimizer.PlanOptimizer.optimize(PlanOptimizer.java:110)
          ... 18 more
      

      Attachments

        1. PIG-3657-1.patch
          4 kB
          Cheolsoo Park

        Activity

          People

            cheolsoo Cheolsoo Park
            cheolsoo Cheolsoo Park
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: