Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-279

Implement predicate push down for hive queries

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.6.0
    • 0.4.0
    • Query Processor
    • None
    • Reviewed

    Description

      Push predicates that are expressed in outer queries into inner queries where possible so that rows will get filtered out sooner.
      eg.

      select a., b. from a join b on (a.uid = b.uid) where a.age = 20 and a.gender = 'm'

      current compiler generates the filter predicate in the reducer after the join so all the rows have to be passed from mapper to reducer. by pushing the filter predicate to the mapper, query performance should improve.

      Attachments

        1. hive-279.patch
          77 kB
          Prasad Chakka
        2. hive-279.6.patch
          1.16 MB
          Prasad Chakka
        3. hive-279.5.patch
          208 kB
          Prasad Chakka
        4. hive-279.4.patch
          119 kB
          Prasad Chakka
        5. hive-279.3.patch
          133 kB
          Prasad Chakka
        6. hive-279.2.patch
          79 kB
          Prasad Chakka

        Issue Links

          Activity

            People

              prasadc Prasad Chakka
              prasadc Prasad Chakka
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: