[HIVE-10158] LLAP: Varchar columns are not handled in encoded readers

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: llap
• Fix Version/s: llap
• Assignee: Prasanth Jayachandran
• Reporter: Gopal Vijayaraghavan
• Created: 31/Mar/15 04:43
• Updated: 17/Feb/16 01:32
• Resolved: 08/Apr/15 06:49

Description

ORC Varchar columns can't be read off the cache

Caused by: java.io.IOException: java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl$VarcharTreeReader cannot be cast to org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl$StringDictionaryTreeReader
        at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat$LlapRecordReader.rethrowErrorIfAny(LlapInputFormat.java:249)
        at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat$LlapRecordReader.nextCvb(LlapInputFormat.java:201)
        at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat$LlapRecordReader.next(LlapInputFormat.java:140)
        at org.apache.hadoop.hive.llap.io.api.impl.LlapInputFormat$LlapRecordReader.next(LlapInputFormat.java:96)
        at org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader.doNext(HiveContextAwareRecordReader.java:350)
        ... 22 more
Caused by: java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl$VarcharTreeReader cannot be cast to org.apache.hadoop.hive.ql.io.orc.RecordReaderImpl$StringDictionaryTreeReader
        at org.apache.hadoop.hive.llap.io.decode.orc.stream.readers.CharacterStreamReader.seek(CharacterStreamReader.java:84)
        at org.apache.hadoop.hive.llap.io.decode.OrcEncodedDataConsumer.createTreeReaders(OrcEncodedDataConsumer.java:332)
        at org.apache.hadoop.hive.llap.io.decode.OrcEncodedDataConsumer.decodeBatch(OrcEncodedDataConsumer.java:98)
        at org.apache.hadoop.hive.llap.io.decode.EncodedDataConsumer.consumeData(EncodedDataConsumer.java:108)
        at org.apache.hadoop.hive.llap.io.decode.EncodedDataConsumer.consumeData(EncodedDataConsumer.java:35)
        at org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.readEncodedColumns(EncodedReaderImpl.java:319)
        at org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:278)
        at org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:48)
        at org.apache.hadoop.hive.common.CallableWithNdc.call(CallableWithNdc.java:37)
        ... 4 more