[SPARK-28494] Expose CalendarIntervalType and CalendarInterval in Spark

• Type: Umbrella
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: PySpark, SparkR, SQL
• Assignee: Unassigned
• Reporter: Hyukjin Kwon
• Created: 24/Jul/19 05:16
• Updated: 12/Dec/22 18:11

Description

CalendarIntervalType and CalendarInterval are rather internal and private for now and are not allowed to be used in some places, for instance, UDFs.

This Jira targets to officially support this type.

Issue Links

• relates to: SPARK-33054 Support interval type in PySpark

Sub-Tasks

• Move `CalendarInterval` to org.apache.spark.sql.types package: Resolved
• Expose and support calendar interval type in SparkSQL: Resolved
• Expose and support calendar interval type in PySpark: Resolved
• Expose and support calendar interval type in SparkR: Resolved