[SPARK-34357] Map JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Target Version/s: 3.2.0
• Assignee: Duc Hoa Nguyen
• Reporter: Duc Hoa Nguyen
• Created: 04/Feb/21 11:08
• Updated: 04/Feb/21 17:19
• Resolved: 04/Feb/21 17:17

Description

Due to user-experience (confusing to Spark users - java.sql.Time using milliseconds vs Spark using microseconds; and user losing useful functions like hour(), minute(), etc on the column), we have decided to revert back to use TimestampType but this time we will enforce the hour to be consistently across system timezone (via offset manipulation)

Full Discussion with Wenchen Fan cloud_fan regarding this ticket is here https://github.com/apache/spark/pull/30902#discussion_r569186823

Related issues: SPARK-33888

Issue Links

• links to: [Github] Pull Request #31473 (saikocat)
• links to: [Github] Pull Request #31473 (saikocat)