Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-279

Implement predicate push down for hive queries

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.4.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Push predicates that are expressed in outer queries into inner queries where possible so that rows will get filtered out sooner.
      eg.

      select a., b. from a join b on (a.uid = b.uid) where a.age = 20 and a.gender = 'm'

      current compiler generates the filter predicate in the reducer after the join so all the rows have to be passed from mapper to reducer. by pushing the filter predicate to the mapper, query performance should improve.

        Attachments

        1. hive-279.patch
          77 kB
          Prasad Chakka
        2. hive-279.2.patch
          79 kB
          Prasad Chakka
        3. hive-279.3.patch
          133 kB
          Prasad Chakka
        4. hive-279.4.patch
          119 kB
          Prasad Chakka
        5. hive-279.5.patch
          208 kB
          Prasad Chakka
        6. hive-279.6.patch
          1.16 MB
          Prasad Chakka

          Issue Links

            Activity

              People

              • Assignee:
                prasadc Prasad Chakka
                Reporter:
                prasadc Prasad Chakka
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: