1. Hive
  2. HIVE-1694

Accelerate GROUP BY execution using indexes


    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.8.0
    • Component/s: Indexing, Query Processor
    • Labels:
    • Hadoop Flags:


      The index building patch (Hive-417) is checked into trunk, this JIRA issue tracks supporting indexes in Hive compiler & execution engine for SELECT queries.

      This is in ref. to John's comment at

      on creating separate JIRA issue for tracking index usage in optimizer & query execution.

      The aim of this effort is to use indexes to accelerate query execution (for certain class of queries). E.g.

      • Filters and range scans (already being worked on by He Yongqiang as part of HIVE-417?)
      • Joins (index based joins)
      • Group By, Order By and other misc cases

      The proposal is multi-step:
      1. Building index based operators, compiler and execution engine changes
      2. Optimizer enhancements (e.g. cost-based optimizer to compare and choose between index scans, full table scans etc.)

      This JIRA initially focuses on the first step. This JIRA is expected to hold the information about index based plans & operator implementations for above mentioned cases.

      1. demo_q1.hql
        0.5 kB
        Nikhil Deshpande
      2. demo_q2.hql
        2 kB
        Nikhil Deshpande
      3. HIVE-1694_2010-10-28.diff
        184 kB
        Nikhil Deshpande
      4. HIVE-1694.1.patch.txt
        259 kB
        Prajakta Kalmegh
      5. HIVE-1694.2.patch.txt
        255 kB
        Prajakta Kalmegh
      6. HIVE-1694.3.patch.txt
        281 kB
        Prajakta Kalmegh
      7. HIVE-1694.4.patch
        114 kB
        Prajakta Kalmegh
      8. HIVE-1694.5.patch
        268 kB
        Prajakta Kalmegh
      9. HIVE-1694.6.patch
        363 kB
        Prajakta Kalmegh
      10. HIVE-1694.7.patch
        369 kB
        Prajakta Kalmegh
      11. HIVE-1694.7.patch
        369 kB
        Prajakta Kalmegh

        Issue Links


          No work has yet been logged on this issue.


            • Assignee:
              Prajakta Kalmegh
              Nikhil Deshpande
            • Votes:
              2 Vote for this issue
              20 Start watching this issue


              • Created: