Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1935

New logical plan: Should not push up filter in front of Bincond

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.1
    • Component/s: impl
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The following script produce wrong result:

      data = LOAD 'data.txt' using PigStorage() as (referrer:chararray, canonical_url:chararray, ip:chararray);
      best_url = FOREACH data GENERATE ((canonical_url != '' and canonical_url is not null) ? canonical_url : referrer) AS url, ip;
      filtered = FILTER best_url BY url == 'badsite.com';
      dump filtered;
      

      data.txt:
      badsite.com 127.0.0.1
      goodsite.com/1?foo=true goodsite.com 127.0.0.1

      Expected:
      (badsite.com,127.0.0.1)

      We get nothing.

      Thanks Corbin Hoenes for reporting.

        Attachments

        1. PIG-1935-1.patch
          2 kB
          Jianyong Dai

          Activity

            People

            • Assignee:
              daijy Jianyong Dai
              Reporter:
              daijy Jianyong Dai
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: