Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2130

Clarify PySpark docs for RDD.getStorageLevel

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.0.0
    • 1.1.0
    • PySpark
    • None

    Description

      The PySpark docs for RDD.getStorageLevel are unclear.

      >>> rdd1 = sc.parallelize([1,2])
      >>> rdd1.getStorageLevel()
      StorageLevel(False, False, False, False, 1)

      What do the 5 values of "False, False, False, False, 1" mean?

      Attachments

        Activity

          People

            kzhang Kan Zhang
            nchammas Nicholas Chammas
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: