Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-6856

Make RDD information more useful in SparkR

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.4.0
    • SparkR

    Description

      Right now in the R console if you have an rdd named say `distData`, then typing `distData` on the console shows something like

      An object of class "RDD"
      Slot "env":
      <environment: 0x7f9181f52188>
      
      Slot "jrdd":
      Java ref type org.apache.spark.api.java.JavaRDD id 86
      

      We should improve this by showing something like in Python

      ParallelCollectionRDD[0] at parallelize at PythonRDD.scala:393
      

      Attachments

        Activity

          People

            Joof Jeff Harrison
            shivaram Shivaram Venkataraman
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: