[CARBONDATA-4047] Datediff datatype is not working with spark-2.4.5. even in spark-sql its showing as null. .Either the query might be wrong or the versions don't support datatypes.

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.0
• Component/s: spark-integration
• Labels: CarbonData hadoop hive spark2.4
• Environment: Hadoop - 3.2.1 ; Hive - 3.1.2 ; Spark - 2.4.5 ; carbon data-2.0 ; mysql connector jar - mysql-connector-java-8.0.19.jar
• Assignee: Unassigned
• Reporter: sravya
• Created: 03/Nov/20 07:03
• Updated: 04/Jan/21 06:22

Description

1.scala> carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 as (select * , intck ("Hours", 'StartTimestamp', 'CompleteTimestamp') as Hours FROM vestedlogs) STORED AS carbondata").show()
<console>:1: error: ')' expected but string literal found.
carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 as (select * , intck ("Hours", 'StartTimestamp', 'CompleteTimestamp') as Hours FROM vestedlogs) STORED AS carbondata").show()

 

2.scala> carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 (SELECT *,DATEDIFF(HOUR,StartTimestamp GETDATE(),CompleteTimestamp GETDATE() AS "Hours" FROM vestedlogs) STORED AS carbondata").show()
<console>:1: error: ')' expected but string literal found.
carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 (SELECT *,DATEDIFF(HOUR,StartTimestamp GETDATE(),CompleteTimestamp GETDATE() AS "Hours" FROM vestedlogs) STORED AS carbondata").show()