[SPARK-44731] Support 'spark.sql.timestampType' in Python Spark Connect client

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0, 4.0.0
• Component/s: Connect, PySpark
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 08/Aug/23 23:53
• Updated: 11/Aug/23 09:35
• Resolved: 11/Aug/23 09:35

Description

If Spark session enables 'spark.sql.timestampType', datetime should be inferred as TimestampNTZ type. However, this isn't implemented yet in Python client side.