Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4637

Partition filter is not pushed down in case of SPLIT

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • parser
    • None

    Description

      A = LOAD 'table1' using org.apache.hive.hcatalog.pig.HCatLoader();
      B = filter A by dt == '20150713';
      C = filter A by dt == '20150714';
      store B into '${output}_1';
      store C into '${output}_2';
      

      where 'dt' is a partition field for 'table1', pig would not try to push down the 'dt' filters due to LOSplit blocking it.

      Attachments

        Activity

          People

            Unassigned Unassigned
            knoguchi Koji Noguchi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: