Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2535

Use sorted nature of compact indexes

    XMLWordPrintableJSON

Details

    Description

      Compact indexes are sorted based on the indexed columns, but we are not using this fact when we access the index.

      To start with, if the index is stored as an RC file, and if the predicate being used to access the index consists of only one non-partition condition using one of the operators >,>=,<,<=,= we could use a binary search (if necessary) to find the block to begin scanning for unfiltered rows, and we could use the result of comparing the value in the column with the constant (this is necessarily the form of a predicate which is optimized using an index) to determine when we have found all the rows which will be unfiltered.

      Attachments

        1. HIVE-2535.4.patch.txt
          89 kB
          Kevin Wilfong
        2. HIVE-2535.3.patch.txt
          85 kB
          Kevin Wilfong
        3. HIVE-2535.2.patch.txt
          75 kB
          Kevin Wilfong
        4. HIVE-2535.1.patch.txt
          66 kB
          Kevin Wilfong

        Activity

          People

            kevinwilfong Kevin Wilfong
            kevinwilfong Kevin Wilfong
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: