[HIVE-24523] Vectorized read path for LazySimpleSerde does not honor the SERDEPROPERTIES for timestamp

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0, 4.0.0
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Vectorization
• Labels: pull-request-available
• Assignee: Naresh P R
• Reporter: Rajkumar Singh
• Created: 11/Dec/20 00:07
• Updated: 17/Nov/22 08:47
• Resolved: 13/Jan/21 08:36

Description

Steps to repro:

  create external  table tstable(date_created timestamp)   ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'   WITH SERDEPROPERTIES (  'timestamp.formats'='yyyyMMddHHmmss') stored as textfile;

cat sampledata 
20201205000017

hdfs dfs -put sampledata /warehouse/tablespace/external/hive/tstable

disable fetch task conversion and run select * from tstable which produce no results, disabling the set hive.vectorized.use.vector.serde.deserialize=false; return the expected output.

while parsing the string to timestamp https://github.com/apache/hive/blob/master/serde/src/java/org/apache/hadoop/hive/serde2/lazy/fast/LazySimpleDeserializeRead.java#L812 does not set the DateTimeFormatter which results IllegalArgumentException while parsing the timestamp through TimestampUtils.stringToTimestamp(strValue)

Issue Links

• links to: GitHub Pull Request #1825