[SPARK-42887] Simple DataType interface

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Component/s: SQL
• Assignee: Rui Wang
• Reporter: Rui Wang
• Created: 21/Mar/23 17:57
• Updated: 04/Aug/23 18:40
• Resolved: 04/Aug/23 18:40

Description

This JIRA proposes to move non public API from existing DataType class to make DataType become a simple interface.

Sub-Tasks

• Move sameType and relevant methods out of DataType: Resolved
• Move Ordering to PhysicalDataType: Resolved
• Move Numeric to PhysicalDataType: Resolved
• Move Integral to PhysicalDataType: Resolved
• Move asIntegral to PhysicalDataType: Resolved
• Move InternalType to PhysicalDataType: Resolved
• Move canWrite to DataTypeUtils: Resolved
• Remove get PhysicalDataType method from Datatype class: Resolved
• Move out json and expression private methods from DataType: Resolved
• Extract shared code from StructType: Resolved
• Extract toAttribute method from StructField to Util class: Resolved
• Extract catalyst code from DecimalType: Resolved
• Move StringConcat to sql/api: Resolved
• Extract SchemaUtils from StructField: Resolved
• Move QueryExecutionErrors to sql/api: Resolved
• Move Metadata to sql/api: Resolved
• Move QueryCompilationErrors to sql/api: Open
• Move Util.truncatedString to sql/api: Resolved
• Move util functions from DataType to ResolveDefaultColumns: Resolved
• Move QueryCompilation error that used by DataType to sql/api as DataTypeErrors: Resolved
• Relocate DataType and Parser to sql/api: Resolved