[HIVE-27513] Iceberg: Fetch task returns wrong results for Timestamp with local time zone datatype for Iceberg tables

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-beta-1
• Component/s: Iceberg integration
• Labels: pull-request-available
• Assignee: Sourabh Badhya
• Reporter: Sourabh Badhya
• Created: 19/Jul/23 07:54
• Updated: 15/Aug/23 06:33
• Resolved: 25/Jul/23 08:33

Description

Fetch task returns wrong results for Timestamp with local time zone datatype for Iceberg tables
Repro queries - 

create external table ice_ts_4(a int, ts timestamp with local time zone) stored by iceberg;
insert into ice_ts_4 values (1, current_timestamp());
set hive.fetch.task.conversion=none;
select * from ice_ts_4;
+-------------+-------------------------------------+
| ice_ts_4.a  |             ice_ts_4.ts             |
+-------------+-------------------------------------+
| 1           | 2021-08-16 06:37:30.425 US/Pacific  |
+-------------+-------------------------------------+

set hive.fetch.task.conversion=more;
select * from ice_ts_4;
+-------------+----------------------------+
| ice_ts_4.a  |        ice_ts_4.ts         |
+-------------+----------------------------+
| 1           | 2021-08-16 13:37:30.425 Z  |
+-------------+----------------------------+ 

Issue Links

• links to: GitHub Pull Request #4498