Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1694

Accelerate GROUP BY execution using indexes

Log workAgile BoardRank to TopRank to BottomVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.8.0
    • Component/s: Indexing, Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The index building patch (Hive-417) is checked into trunk, this JIRA issue tracks supporting indexes in Hive compiler & execution engine for SELECT queries.

      This is in ref. to John's comment at

      https://issues.apache.org/jira/browse/HIVE-417?focusedCommentId=12884869&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12884869

      on creating separate JIRA issue for tracking index usage in optimizer & query execution.

      The aim of this effort is to use indexes to accelerate query execution (for certain class of queries). E.g.

      • Filters and range scans (already being worked on by He Yongqiang as part of HIVE-417?)
      • Joins (index based joins)
      • Group By, Order By and other misc cases

      The proposal is multi-step:
      1. Building index based operators, compiler and execution engine changes
      2. Optimizer enhancements (e.g. cost-based optimizer to compare and choose between index scans, full table scans etc.)

      This JIRA initially focuses on the first step. This JIRA is expected to hold the information about index based plans & operator implementations for above mentioned cases.

        Attachments

        1. demo_q1.hql
          0.5 kB
          Nikhil Deshpande
        2. demo_q2.hql
          2 kB
          Nikhil Deshpande
        3. HIVE-1694_2010-10-28.diff
          184 kB
          Nikhil Deshpande
        4. HIVE-1694.1.patch.txt
          259 kB
          Prajakta Kalmegh
        5. HIVE-1694.2.patch.txt
          255 kB
          Prajakta Kalmegh
        6. HIVE-1694.3.patch.txt
          281 kB
          Prajakta Kalmegh
        7. HIVE-1694.4.patch
          114 kB
          Prajakta Kalmegh
        8. HIVE-1694.5.patch
          268 kB
          Prajakta Kalmegh
        9. HIVE-1694.6.patch
          363 kB
          Prajakta Kalmegh
        10. HIVE-1694.7.patch
          369 kB
          Prajakta Kalmegh
        11. HIVE-1694.7.patch
          369 kB
          Prajakta Kalmegh

        Issue Links

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              pkalmegh Prajakta Kalmegh Assign to me
              Reporter:
              nikhail Nikhil Deshpande

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment