[ORC-412] [C++] ORC: Char(n) and Varchar(n) writers truncate to n bytes & corrupts multi-byte data

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.5.2
• Fix Version/s: 1.6.0
• Assignee: Gang Wu
• Reporter: Gang Wu
• Created: 09/Oct/18 07:04
• Updated: 04/Sep/19 02:00
• Resolved: 05/Nov/18 23:04

Description

https://github.com/apache/orc/blob/master/java/core/src/java/org/apache/orc/impl/writer/CharTreeWriter.java#L41

    itemLength = schema.getMaxLength();
    padding = new byte[itemLength];
  }

https://github.com/apache/orc/blob/master/java/core/src/java/org/apache/orc/impl/writer/VarcharTreeWriter.java#L48

      if (vector.noNulls || !vector.isNull[0]) {
        int itemLength = Math.min(vec.length[0], maxLength);

Issue Links

• is a clone of: ORC-406 ORC: Char(n) and Varchar(n) writers truncate to n bytes & corrupts multi-byte data
• is related to: HIVE-20520 length(CHAR) doesn't consider trailing space
• links to: GitHub Pull Request #310
• links to: GitHub Pull Request #317