Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1694

Accelerate GROUP BY execution using indexes

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.8.0
    • Component/s: Indexing, Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The index building patch (Hive-417) is checked into trunk, this JIRA issue tracks supporting indexes in Hive compiler & execution engine for SELECT queries.

      This is in ref. to John's comment at

      https://issues.apache.org/jira/browse/HIVE-417?focusedCommentId=12884869&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12884869

      on creating separate JIRA issue for tracking index usage in optimizer & query execution.

      The aim of this effort is to use indexes to accelerate query execution (for certain class of queries). E.g.

      • Filters and range scans (already being worked on by He Yongqiang as part of HIVE-417?)
      • Joins (index based joins)
      • Group By, Order By and other misc cases

      The proposal is multi-step:
      1. Building index based operators, compiler and execution engine changes
      2. Optimizer enhancements (e.g. cost-based optimizer to compare and choose between index scans, full table scans etc.)

      This JIRA initially focuses on the first step. This JIRA is expected to hold the information about index based plans & operator implementations for above mentioned cases.

        Attachments

        1. demo_q1.hql
          0.5 kB
          Nikhil Deshpande
        2. demo_q2.hql
          2 kB
          Nikhil Deshpande
        3. HIVE-1694_2010-10-28.diff
          184 kB
          Nikhil Deshpande
        4. HIVE-1694.1.patch.txt
          259 kB
          Prajakta Kalmegh
        5. HIVE-1694.2.patch.txt
          255 kB
          Prajakta Kalmegh
        6. HIVE-1694.3.patch.txt
          281 kB
          Prajakta Kalmegh
        7. HIVE-1694.4.patch
          114 kB
          Prajakta Kalmegh
        8. HIVE-1694.5.patch
          268 kB
          Prajakta Kalmegh
        9. HIVE-1694.6.patch
          363 kB
          Prajakta Kalmegh
        10. HIVE-1694.7.patch
          369 kB
          Prajakta Kalmegh
        11. HIVE-1694.7.patch
          369 kB
          Prajakta Kalmegh

          Issue Links

            Activity

              People

              • Assignee:
                pkalmegh Prajakta Kalmegh
                Reporter:
                nikhail Nikhil Deshpande
              • Votes:
                2 Vote for this issue
                Watchers:
                20 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: