[SPARK-11010] Fixes and enhancements addressing UDTs' api and several usability concerns

• Type: Epic
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 1.5.0, 1.5.1
• Component/s: SQL
• Labels: UDT bulk-closed
• Epic Name: UserDefinedType enhancements
• Assignee: Unassigned
• Reporter: John Muller
• Created: 08/Oct/15 19:33
• Updated: 21/May/19 04:12
• Resolved: 21/May/19 04:12

Description

Catalyst SQL types allow for UserDefinedTypes, but do not allow for easy extension of 3rd party types or extensions to built-in types like DecimalType or StringType (private classes).

Additionally, the API can infer much more of what's needed from the type parameter than it currently does.

Issue Links

• incorporates: SPARK-7768 Make user-defined type (UDT) API public
• incorporates: SPARK-11003 Allowing UserDefinedTypes to extend primatives
• relates to: SPARK-10855 Add a JDBC dialect for Apache Derby