[SPARK-5123] Stabilize Spark SQL data type API

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: SQL
• Target Version/s: 1.3.0
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 07/Jan/15 05:47
• Updated: 14/Jan/15 01:16
• Resolved: 14/Jan/15 01:16

Description

Having two versions of the data type APIs (one for Java, one for Scala) requires downstream libraries to also have two versions of the APIs if the library wants to support both Java and Scala. I took a look at the Scala version of the data type APIs - it can actually work out pretty well for Java out of the box.

The proposal is to move Spark SQL data type definitions from org.apache.spark.sql.catalyst.types into org.apache.spark.sql.types, and make the existing Scala type API usable in Java.

Issue Links

• blocks: SPARK-5097 Adding data frame APIs to SchemaRDD
• blocks: SPARK-5193 Make Spark SQL API usable in Java and remove the Java-specific API
• links to: [Github] Pull Request #3925 (rxin)
• links to: [Github] Pull Request #3958 (rxin)