[HIVE-25446] Wrong exception thrown if capacity<=0

• Type: Sub-task
• Status: Closed
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 3.1.2
• Fix Version/s: 4.0.0-alpha-2
• Component/s: Vectorization
• Labels: pull-request-available
• Assignee: Ashish Sharma
• Reporter: Matt McCline
• Created: 12/Aug/21 04:25
• Updated: 17/Nov/22 13:14
• Resolved: 23/Mar/22 04:28

Description

Encountered this in a very large query:

Caused by: java.lang.AssertionError: Capacity must be a power of two

       at org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTable.validateCapacity(VectorMapJoinFastHashTable.java:60)

       at org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTable.<init>(VectorMapJoinFastHashTable.java:77)

       at org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastBytesHashTable.<init>(VectorMapJoinFastBytesHashTable.java:132)

       at org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastBytesHashMap.<init>(VectorMapJoinFastBytesHashMap.java:166)

       at org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastStringHashMap.<init>(VectorMapJoinFastStringHashMap.java:43)

       at org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastTableContainer.createHashTable(VectorMapJoinFastTableContainer.java:137)

       at org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastTableContainer.<init>(VectorMapJoinFastTableContainer.java:86)

       at org.apache.hadoop.hive.ql.exec.vector.mapjoin.fast.VectorMapJoinFastHashTableLoader.load(VectorMapJoinFastHashTableLoader.java:122)

       at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTableInternal(MapJoinOperator.java:344)

       at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:413)

       at org.apache.hadoop.hive.ql.exec.MapJoinOperator.lambda$initializeOp$0(MapJoinOperator.java:215)

       at org.apache.hadoop.hive.ql.exec.tez.ObjectCache.retrieve(ObjectCache.java:96)

       at org.apache.hadoop.hive.ql.exec.tez.ObjectCache$1.call(ObjectCache.java:113)

       at java.util.concurrent.FutureTask.run(FutureTask.java:266)

Issue Links

• Is contained by: HIVE-26751 Bug Fixes and Improvements for 3.2.0 release
• links to: GitHub Pull Request #3092