Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-44589

Migrate PySpark tests to use PySpark built-in test utils

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.5.0
    • None
    • PySpark
    • None

    Description

      The Jira ticket SPARK-44042 SPIP: PySpark Test Framework introduces a new PySpark test framework. Some of the user-facing testing util APIs include assertDataFrameEqual, assertSchemaEqual, and assertPandasOnSparkEqual.

      With the new testing framework, we should migrate old tests in the Spark codebase to use the new testing utils.

      Attachments

        Activity

          People

            Unassigned Unassigned
            asl3 Amanda Liu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: