Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-42497 Support of pandas API on Spark for Spark Connect
  3. SPARK-44052

Add util to get proper Column or DataFrame class for Spark Connect.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.5.0
    • 3.5.0
    • None

    Description

      There are many codes are duplicated to get proper PySparkColumn or PySparkDataFrame, so it would be great if we have util function to deduplicate these codes.

      Attachments

        Activity

          People

            itholic Haejoon Lee
            itholic Haejoon Lee
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: