Details
-
Type:
Sub-task
-
Status: Resolved
-
Priority:
Major
-
Resolution: Fixed
-
Affects Version/s: vectorization-branch
-
Fix Version/s: vectorization-branch, 0.13.0
-
Component/s: Query Processor
-
Labels:None
Description
the row mode GBy operator is capable of spilling the hash map (by emitting it into the M/R and deleting the keys emitted) to conform to emmory constraints. The VGBy should be able to do the same.
Activity
- All
- Comments
- Work Log
- History
- Activity
- Transitions
It probably is a good idea to use(or enhance) ql/src/java/org/apache/hadoop/hive/ql/util/JavaDataModel.java for estimating memory sizes of object than adding a new one.
Show
Ashutosh Chauhan
added a comment - It probably is a good idea to use(or enhance) ql/src/java/org/apache/hadoop/hive/ql/util/JavaDataModel.java for estimating memory sizes of object than adding a new one.
Removed JavaObjectSizeUtil, replaced with JavaDataModel
Show
Remus Rusanu
added a comment - Removed JavaObjectSizeUtil, replaced with JavaDataModel
Committed to branch. Thanks, Remus!
Show
Ashutosh Chauhan
added a comment - Committed to branch. Thanks, Remus!
https://reviews.apache.org/r/11747/