Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3461

Rewrite PartitionFilterOptimizer to make it work for all the cases

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.11.1
    • 0.12.0
    • impl
    • None

    Description

      Current algorithm for Partition Filter pushdown identification fails in several corner cases. We need to rewrite its logic so that it works in all cases and does the maximum possible filter pushdown.

      Attachments

        1. PIG-3461-2.patch
          18 kB
          Aniket Namadeo Mokashi
        2. PIG-3461-4.patch
          67 kB
          Aniket Namadeo Mokashi
        3. PIG-3461-6.patch
          69 kB
          Aniket Namadeo Mokashi

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. PIG-3510 New filter extractor fails with more than one filter statement

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. PIG-3594 Pig 0.11 with HCatLoader partition filter does not push down valid conditions

          • Major - Major loss of function.
          • Open
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. PIG-3300 Optimize partition filter pushdown

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              aniket486 Aniket Namadeo Mokashi
              aniket486 Aniket Namadeo Mokashi
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: