Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12144

Support more external data source API in SparkR

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.5.2
    • Fix Version/s: 1.6.0
    • Component/s: SparkR
    • Labels:
      None

      Description

      Currently we support read.df, write.df, jsonFile, parquetFile in SQLContext, we should support more external data source API such as read.json, read.parquet, read.orc, read.jdbc, read.csv and so on.
      Some of the exist API is deprecated and will remove at Spark 2.0, we should also deprecate them at SparkR.
      Note: we should refer the DataFrameReader and DataFrameWriter API at Spark SQL but defined with R-like style.
      DataFrameReader API: http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrameReader
      DataFrameWriter API: http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrameWriter

        Attachments

          Issue Links

          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                yanboliang Yanbo Liang
                Reporter:
                sunrui Sun Rui
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: