[HIVE-7191] optimized map join hash table has a bug when it reaches 2Gb

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Assignee: Sergey Shelukhin
• Reporter: Sergey Shelukhin
• Created: 06/Jun/14 21:08
• Updated: 13/Nov/14 19:39
• Resolved: 07/Jun/14 15:49

Description

Via t3rmin4t0r:

Caused by: java.lang.ArrayIndexOutOfBoundsException: -204

        at java.util.ArrayList.elementData(ArrayList.java:371)

        at java.util.ArrayList.get(ArrayList.java:384)

        at org.apache.hadoop.hive.serde2.WriteBuffers.setReadPoint(WriteBuffers.java:95)

        at org.apache.hadoop.hive.serde2.WriteBuffers.hashCode(WriteBuffers.java:100)

        at org.apache.hadoop.hive.ql.exec.persistence.BytesBytesMultiHashMap.put(BytesBytesMultiHashMap.java:203)

        at org.apache.hadoop.hive.ql.exec.persistence.MapJoinBytesTableContainer.putRow(MapJoinBytesTableContainer.java:266)

        at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:124)

        ... 16 more