Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4606

Implement vector group by hash spill

        Details

          Description

          the row mode GBy operator is capable of spilling the hash map (by emitting it into the M/R and deleting the keys emitted) to conform to emmory constraints. The VGBy should be able to do the same.

          1. Text File
            HIVE-4606.1.patch.txt
            94 kB
            Remus Rusanu
          2. Text File
            HIVE-4606.2.patch.txt
            94 kB
            Remus Rusanu
          3. Text File
            HIVE-4606.3.patch.txt
            93 kB
            Remus Rusanu

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            rusanu Remus Rusanu added a comment -

            https://reviews.apache.org/r/11747/

            Show
            rusanu Remus Rusanu added a comment - https://reviews.apache.org/r/11747/
            Hide
            Permalink
            ashutoshc Ashutosh Chauhan added a comment -

            It probably is a good idea to use(or enhance) ql/src/java/org/apache/hadoop/hive/ql/util/JavaDataModel.java for estimating memory sizes of object than adding a new one.

            Show
            ashutoshc Ashutosh Chauhan added a comment - It probably is a good idea to use(or enhance) ql/src/java/org/apache/hadoop/hive/ql/util/JavaDataModel.java for estimating memory sizes of object than adding a new one.
            Hide
            Permalink
            rusanu Remus Rusanu added a comment -

            Removed JavaObjectSizeUtil, replaced with JavaDataModel

            Show
            rusanu Remus Rusanu added a comment - Removed JavaObjectSizeUtil, replaced with JavaDataModel
            Hide
            Permalink
            ashutoshc Ashutosh Chauhan added a comment -

            Committed to branch. Thanks, Remus!

            Show
            ashutoshc Ashutosh Chauhan added a comment - Committed to branch. Thanks, Remus!

              People

              • Assignee:
                rusanu Remus Rusanu
                Reporter:
                rusanu Remus Rusanu
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development