[SPARK-5420] Cross-langauge load/store functions for creating and saving DataFrames

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Component/s: SQL
• Target Version/s: 1.3.0
• Assignee: Yin Huai
• Reporter: Patrick Wendell
• Created: 27/Jan/15 02:42
• Updated: 11/Feb/15 05:53
• Resolved: 03/Feb/15 19:00

Description

We should have standard API's for loading or saving a table from a data store. Per comment discussion:

def loadData(datasource: String, parameters: Map[String, String]): DataFrame
def loadData(datasource: String, parameters: java.util.Map[String, String]): DataFrame
def storeData(datasource: String, parameters: Map[String, String]): DataFrame
def storeData(datasource: String, parameters: java.util.Map[String, String]): DataFrame

Python should have this too.

Issue Links

• contains: SPARK-4945 Add overwrite option support for SchemaRDD.saveAsParquetFile
• is related to: SPARK-5501 Write support for the data source API
• links to: [Github] Pull Request #4294 (yhuai)