Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-39253

Improve PySpark API reference to be more readable

    XMLWordPrintableJSON

Details

    • Test
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.3.0, 3.4.0
    • Documentation, PySpark
    • None

    Description

      Currently, the PySpark documentation especially "Spark SQL" part is not-well organized so it's a bit uncomfortable to be read.

      For example, the pyspark.sql.SparkSession class shows every available method its sub-contents, but pyspark.sql.DataFrameReader doesn't have it's own top-level class page, and also its available methods.

      So we might need to refine the document to make it more readable so that users can easily find the methods they want.

      Attachments

        Activity

          People

            itholic Haejoon Lee
            itholic Haejoon Lee
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: