Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2247

Data frame (or Pandas) like API for structured data

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.0.0
    • None
    • PySpark, Spark Core, SQL

    Description

      I would be nice to have R or python pandas like data frames on spark.
      1) To be able to access the RDD data frame from python with pandas
      2) To be able to access the RDD data frame from R
      3) To be able to access the RDD data frame from scala's saddle

      Attachments

        Issue Links

          contains

          New Feature - A new feature of the product, which has yet to be developed. SPARK-4589 ML add-ons to SchemaRDD

          • Major - Major loss of function.
          • Closed
          duplicates

          Sub-task - The sub-task of the issue SPARK-5097 Adding data frame APIs to SchemaRDD

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              rxin Reynold Xin
              venuktan venu k tangirala
              Votes:
              2 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: