[HIVE-22459] Hive datadiff function provided inconsistent results when hive.ferch.task.conversion is set to none

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 3.0.0
• Component/s: HiveServer2
• Assignee: Unassigned
• Reporter: Chiran Ravani
• Created: 05/Nov/19 10:38
• Updated: 01/Jun/20 21:59
• Resolved: 01/Jun/20 21:59

Description

Hive datadiff function provided inconsistent results when hive.ferch.task.conversion to more

Below is output, whereas in Hive 1.2 the results are consistent

Note: Same query works well on Hive 3 when hive.ferch.task.conversion is set to none
Steps to reproduce the problem.

0: jdbc:hive2://c1113-node2.squadron.support.> select datetimecol from testdatediff where datediff(cast(current_timestamp as string), datetimecol)<183;
INFO : Compiling command(queryId=hive_20191105103636_1dff22a1-02f3-48a8-b076-0b91272f2268): select datetimecol from testdatediff where datediff(cast(current_timestamp as string), datetimecol)<183
INFO : Semantic Analysis Completed (retrial = false)
INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:datetimecol, type:string, comment:null)], properties:null)
INFO : Completed compiling command(queryId=hive_20191105103636_1dff22a1-02f3-48a8-b076-0b91272f2268); Time taken: 0.479 seconds
INFO : Executing command(queryId=hive_20191105103636_1dff22a1-02f3-48a8-b076-0b91272f2268): select datetimecol from testdatediff where datediff(cast(current_timestamp as string), datetimecol)<183
INFO : Completed executing command(queryId=hive_20191105103636_1dff22a1-02f3-48a8-b076-0b91272f2268); Time taken: 0.013 seconds
INFO : OK
+--------------+
| datetimecol |
+--------------+
| 2019-07-24 |
+--------------+
1 row selected (0.797 seconds)
0: jdbc:hive2://c1113-node2.squadron.support.>

After setting fetch task conversion as none.

0: jdbc:hive2://c1113-node2.squadron.support.> set hive.fetch.task.conversion=none;
No rows affected (0.017 seconds)
0: jdbc:hive2://c1113-node2.squadron.support.> set hive.fetch.task.conversion;
+----------------------------------+
| set |
+----------------------------------+
| hive.fetch.task.conversion=none |
+----------------------------------+
1 row selected (0.015 seconds)
0: jdbc:hive2://c1113-node2.squadron.support.> select datetimecol from testdatediff where datediff(cast(current_timestamp as string), datetimecol)<183;
INFO : Compiling command(queryId=hive_20191105103709_0c38e446-09cf-45dd-9553-365146f42452): select datetimecol from testdatediff where datediff(cast(current_timestamp as string), datetimecol)<183


+----------------------------+
| datetimecol |
+----------------------------+
| 2019-09-09T10:45:49+02:00 |
| 2019-07-24 |
+----------------------------+
2 rows selected (5.327 seconds)
0: jdbc:hive2://c1113-node2.squadron.support.>

Steps to reproduce

create external table testdatediff(datetimecol string) stored as orc;
insert into testdatediff values ('2019-09-09T10:45:49+02:00'),('2019-07-24');
select datetimecol from testdatediff where datediff(cast(current_timestamp as string), datetimecol)<183;

set hive.ferch.task.conversion=none;
select datetimecol from testdatediff where datediff(cast(current_timestamp as string), datetimecol)<183;

Issue Links

• duplicates: HIVE-22476 Hive datediff function provided inconsistent results when hive.fetch.task.conversion is set to none