[SPARK-5097] Adding data frame APIs to SchemaRDD

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: SQL
• Target Version/s: 1.3.0
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 06/Jan/15 07:11
• Updated: 28/Jan/15 08:03
• Resolved: 28/Jan/15 08:03

Description

SchemaRDD, through its DSL, already provides common data frame functionalities. However, the DSL was originally created for constructing test cases without much end-user usability and API stability consideration. This design doc proposes a set of API changes for Scala and Python to make the SchemaRDD DSL API more usable and stable.

Issue Links

• is blocked by: SPARK-5123 Stabilize Spark SQL data type API
• is duplicated by: SPARK-2247 Data frame (or Pandas) like API for structured data
• links to: [Github] Pull Request #4173 (rxin)
• links to: [Github] Pull Request #4235 (rxin)
• links to: [Github] Pull Request #4241 (rxin)