Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
The actual issue stems to the different date parser used by various part of the engine.
Fetch task uses udfdatediff via
org.apache.hadoop.hive.ql.udf.generic.GenericUDFToDate
while the vectorized llap execution uses
VectorUDFDateDiffScalarCol
.
This fix is meant to be not very intrusive and will add more support to the GenericUDFToDate by enhancing the parser.
For the longer term will be better to use one parser for all the operators.
Thanks Rajkumar Singh for the repro example
create external table testdatediff(datetimecol string) stored as orc; insert into testdatediff values ('2019-09-09T10:45:49+02:00'),('2019-07-24'); select datetimecol from testdatediff where datediff(cast(current_timestamp as string), datetimecol)<183; set hive.ferch.task.conversion=none; select datetimecol from testdatediff where datediff(cast(current_timestamp as string), datetimecol)<183;
Attachments
Attachments
Issue Links
- is duplicated by
-
HIVE-22459 Hive datadiff function provided inconsistent results when hive.ferch.task.conversion is set to none
-
- Resolved
-
- links to