[HIVE-6005] BETWEEN is broken after using KRYO

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.13.0
• Fix Version/s: 0.13.0
• Assignee: Unassigned
• Reporter: Eric Chu
• Created: 11/Dec/13 07:21
• Updated: 23/Mar/14 17:40
• Resolved: 12/Dec/13 00:41

Description

After taking in HIVE-1511, HIVE-5422, and HIVE-5257 on top of Hive 0.12 to use Kryo, queries with BETWEEN start to fail with the following exception:

com.esotericsoftware.kryo.KryoException: Class cannot be created (missing no-arg constructor): org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableConstantBooleanObjectInspector
Serialization trace:
argumentOIs (org.apache.hadoop.hive.ql.udf.generic.GenericUDFBetween)
genericUDF (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc)
filters (org.apache.hadoop.hive.ql.plan.JoinDesc)
conf (org.apache.hadoop.hive.ql.exec.JoinOperator)
reducer (org.apache.hadoop.hive.ql.plan.ReduceWork)
at com.esotericsoftware.kryo.Kryo.newInstantiator(Kryo.java:1097)
at com.esotericsoftware.kryo.Kryo.newInstance(Kryo.java:1109)
at com.esotericsoftware.kryo.serializers.FieldSerializer.create(FieldSerializer.java:526)
...

A workaround is to replace BETWEEN with >= and <=, but I think this failure is a bug and not by design.

Issue Links

• is broken by: HIVE-1511 Hive plan serialization is slow
• Is contained by: HIVE-5263 Query Plan cloning time could be improved by using Kryo