[HIVE-17593] DataWritableWriter strip spaces for CHAR type before writing, but predicate generator doesn't do same thing.

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.3.0, 3.0.0
• Labels: pull-request-available
• Target Version/s: 3.1.0
• Assignee: Junjie Chen
• Reporter: Junjie Chen
• Created: 25/Sep/17 03:03
• Updated: 26/Jun/19 00:50

Description

DataWritableWriter strip spaces for CHAR type before writing. While when generating predicate, it does NOT do same striping which should cause data missing!

In current version, it doesn't cause data missing since predicate is not well push down to parquet due to HIVE-17261.

Please see ConvertAstTosearchArg.java, getTypes treats CHAR and STRING as same which will build a predicate with tail spaces.

Issue Links

• Blocked: HIVE-17261 Hive use deprecated ParquetInputSplit constructor which blocked parquet dictionary filter
• links to: GitHub Pull Request #383
• links to: GitHub Pull Request #383