[SPARK-5295] Stabilize data types

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: SQL
• Target Version/s: 1.5.0
• Sprint: Spark 1.5 doc/QA sprint
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 17/Jan/15 05:13
• Updated: 18/Jul/15 07:36
• Resolved: 18/Jul/15 07:36

Description

1. We expose all the stuff in data types right now, including NumericTypes, etc. These should be hidden from users. We should only expose the leaf types.

2. Remove DeveloperAPI tag from the common types.

3. Specify the internal type, external scala type, and external java type for each data type.

4. Add conversion functions between internal type, external scala type, and external java type into each type.

Issue Links

• is related to: SPARK-5288 Stabilize Spark SQL data type API followup