[HIVE-17984] getMaxLength is not returning the correct lengths for Char/Varchar types while reading the ORC file from WebHDFS file system

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Hive, ORC

Environment

tested it against hive-exec 2.1

• Assignee: Unassigned
• Reporter: Syam
• Due: 06/Nov/17
• Created: 05/Nov/17 20:22
• Updated: 06/Nov/17 15:05

Description

getMaxLength is not returning the correct length for char/varchar datatypes.
I see that getMaxLength is returning 255 for CHAR type and 65535 for VARCHAR type.
When I checked the same file using orcfiledump utility, I could see the correct lengths.

Here is the snippet of the code:

Reader _reader = OrcFile.createReader(new Path(_fileName),OrcFile.readerOptions(conf).filesystem(fs)) ;
TypeDescription metarec = _reader.getSchema() ;
List <TypeDescription> cols = metarec.getChildren();
List <String> colNames = metarec.getFieldNames();
for (int i=0; i < cols.size(); i++)
{
TypeDescription fieldSchema = cols.get;

switch (fieldSchema.getCategory())

{ case CHAR: header += "char(" + fieldSchema.getMaxLength() + ")" ; break; ---------- ---------- }

}

Please let me know your pointers please.