Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-41651

Test parity: pyspark.sql.tests.test_dataframe

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Done
    • 3.4.0
    • None
    • Connect
    • None

    Description

      After https://github.com/apache/spark/pull/39041 (SPARK-41528), we now reuses the same test cases, see python/pyspark/sql/tests/connect/test_parity_dataframe.py.

      We should remove all the test cases defined there, and fix Spark Connect behaviours accordingly.

      Attachments

        Issue Links

        is part of

        Umbrella - An overarching type made of sub-tasks SPARK-41285 Test basework and improvement of test coverage in Spark Connect

        • Critical - Crashes, loss of data, severe memory leak.
        • Open
        There are no Sub-Tasks for this issue.

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            techaddict Sandeep Singh
            gurwls223 Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment