Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-47970

Revisit skipped parity tests for PySpark Connect

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 4.0.0
    • None
    • Connect, PySpark
    • None

    Attachments

      Issue Links

        is related to

        Umbrella - An overarching type made of sub-tasks SPARK-44111 Prepare Apache Spark 4.0.0

        • Critical - Crashes, loss of data, severe memory leak.
        • Open
        1.
        		 Enable `QuietTest` in parity tests Sub-task Resolved Ruifeng Zheng
        2.
        		 Reuse `test_help_command` in Connect Sub-task Resolved Ruifeng Zheng
        3.
        		 Enable PandasUDFGroupedAggParityTests. test_grouped_with_empty_partition Sub-task Resolved Ruifeng Zheng
        4.
        		 Enable `ArrowParityTests.test_createDataFrame_empty_partition` Sub-task Resolved Ruifeng Zheng
        5.
        		 Enable `DefaultIndexParityTests. test_index_distributed_sequence_cleanup` Sub-task Resolved Ruifeng Zheng
        6.
        		 Enable `UDFParityTests.test_udf_timestamp_ntz` Sub-task Resolved Ruifeng Zheng
        7.
        		 Update the error class for `group.apply` Sub-task Resolved Ruifeng Zheng
        8.
        		 Enable PandasUDFScalarParityTests.{test_vectorized_udf_empty_partition, test_vectorized_udf_struct_with_empty_partition} Sub-task Resolved Ruifeng Zheng
        9.
        		 Enable `GroupedApplyInPandasTests. test_grouped_with_empty_partition` Sub-task Resolved Ruifeng Zheng
        10.
        		 `UserDefinedFunction.returnType` parse the DDL string Sub-task Resolved Ruifeng Zheng
        11.
        		 Enable `CogroupedApplyInPandasTests.test_wrong_args` Sub-task Resolved Ruifeng Zheng
        12.
        		 Enable `PandasUDFGroupedAggParityTests.test_manual` Sub-task Resolved Ruifeng Zheng
        13.
        		 Enable `ArrowPythonUDFParityTests.test_err_return_type` Sub-task Resolved Ruifeng Zheng
        14.
        		 Introduce a helper function to drop metadata Sub-task Resolved Ruifeng Zheng
        15.
        		 Fully enable PandasUDFParityTests. test_udf_wrong_arg Sub-task Resolved Ruifeng Zheng
        16.
        		 Implement the missing function validation in ApplyInXXX Sub-task Resolved Ruifeng Zheng
        17.
        		 Fix comments for SparkFrameMethodsParityTests.test_coalesce and test_repartition Sub-task Resolved Hyukjin Kwon
        18.
        		 Enable test_udtf_with_analyze_using_archive and test_udtf_with_analyze_using_file Sub-task Resolved Hyukjin Kwon
        19.
        		 Test `assert_true` and `raise_error` with the same error class as Spark Classic Sub-task Resolved Ruifeng Zheng
        20.
        		 Test `test_sorting_functions_with_column` with same `Column` Sub-task Resolved Ruifeng Zheng

        Activity

          People

            Unassigned Unassigned
            podongfeng Ruifeng Zheng
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: