Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4246

Implement predicate pushdown for ORC

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • File Formats
    • None

    Description

      By using the push down predicates from the table scan operator, ORC can skip over 10,000 rows at a time that won't satisfy the predicate. This will help a lot, especially if the file is sorted by the column that is used in the predicate.

      Attachments

        1. HIVE-4246.D11415.1.patch
          119 kB
          Phabricator
        2. HIVE-4246.D11415.2.patch
          119 kB
          Phabricator
        3. HIVE-4246.D11415.3.patch
          124 kB
          Phabricator
        4. HIVE-4246.D11415.3.patch
          124 kB
          Phabricator
        5. HIVE-4246.D11415.4.patch
          178 kB
          Phabricator
        6. HIVE-4246.D11415.5.patch
          178 kB
          Phabricator
        7. HIVE-4246.D11415.6.patch
          178 kB
          Phabricator

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-4579 Create a SARG interface for RecordReaders

          • Major - Major loss of function.
          • Closed
          is depended upon by

          Test - A new unit, integration or system test. HIVE-5096 Add q file tests for ORC predicate pushdown

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-4062 use column statistics for ORC to evaluate predicates for ORC

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              omalley Owen O'Malley
              omalley Owen O'Malley
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: