Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-41285

Test basework and improvement of test coverage in Spark Connect

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • 3.4.0
    • None
    • Connect, Tests
    • None

    Attachments

      Issue Links

        incorporates

        Umbrella - An overarching type made of sub-tasks SPARK-41642 Deduplicate docstrings in Python Spark Connect

        • Major - Major loss of function.
        • Resolved

        Umbrella - An overarching type made of sub-tasks SPARK-41651 Test parity: pyspark.sql.tests.test_dataframe

        • Major - Major loss of function.
        • Resolved

        Umbrella - An overarching type made of sub-tasks SPARK-41652 Test parity: pyspark.sql.tests.test_functions

        • Major - Major loss of function.
        • Resolved

        Umbrella - An overarching type made of sub-tasks SPARK-41653 Test parity: enable doctests in Spark Connect

        • Major - Major loss of function.
        • Resolved
        1.
        		 Extend test coverage of Analyzer Sub-task Open Unassigned
        2.
        		 Extend test coverage for Spark Connect Python client Sub-task Open Unassigned
        3.
        		 Disable ANSI mode in pyspark.sql.tests.connect.test_connect_column Sub-task Open Unassigned
        4.
        		 Reenable ANSI mode in pyspark.sql.tests.connect.test_connect_column Sub-task Open Ruifeng Zheng
        5.
        		 Reenable ANSI mode in pyspark.sql.tests.connect.test_connect_functions Sub-task Open Xinrong Meng
        6.
        		 Create pyspark.sql.connect.utils to keep common codes Sub-task Resolved Hyukjin Kwon
        7.
        		 Catch specific exceptions for both Spark Connect and PySpark Sub-task Resolved Hyukjin Kwon
        8.
        		 Use available ephemeral port for Spark Connect server in testing Sub-task Resolved Hyukjin Kwon
        9.
        		 Skip Spark Connect tests if dependencies are not installed Sub-task Resolved Hyukjin Kwon
        10.
        		 Connect module should use log4j2.properties to configure test log output as other modules Sub-task Resolved Yang Jie
        11.
        		 Run Scala side tests in GitHub Actions Sub-task Resolved Hyukjin Kwon
        12.
        		 Use uniitest's asserts instead of built-in assert Sub-task Resolved Hyukjin Kwon
        13.
        		 Drop Python test tables before and after unit tests Sub-task Resolved Rui Wang
        14.
        		 pyspark-connect tests should be skipped if pandas doesn't exist Sub-task Resolved Dongjoon Hyun
        15.
        		 Migrate markdown style README to python/docs/development/testing.rst Sub-task Resolved Hyukjin Kwon
        16.
        		 Refactor pandas, pyarrow and grpc check in tests Sub-task Resolved Hyukjin Kwon
        17.
        		 Run Coverage report for Spark Connect Sub-task Resolved Hyukjin Kwon
        18.
        		 Disable ANSI mode in pyspark.sql.tests.connect.test_connect_functions Sub-task Resolved Hyukjin Kwon
        19.
        		 Combine plan-related tests Sub-task Resolved Ruifeng Zheng
        20.
        		 Fix gRPC check in tests Sub-task Resolved Xinrong Meng
        21.
        		 Make `ReusedConnectTestCase` to take Spark configurations Sub-task Resolved Hyukjin Kwon
        22.
        		 Avoid using RemoteSparkSession.builder.getOrCreate in tests Sub-task Resolved Hyukjin Kwon
        23.
        		 Tear down the test cleanly Sub-task Resolved Takuya Ueshin

        Activity

          People

            gurwls223 Hyukjin Kwon
            gurwls223 Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: