[SPARK-38871] Improve the test coverage for PySpark/rddsampler.py

• Type: Umbrella
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 3.3.0
• Component/s: PySpark, Tests
• Assignee: Unassigned
• Reporter: Pralabh Kumar
• Created: 12/Apr/22 13:04
• Updated: 12/Apr/22 13:10
• Resolved: 12/Apr/22 13:09

Description

Currently, PySpark test coverage is around 91% according to codecov report: https://app.codecov.io/gh/apache/spark

Since there are still 9% missing tests, so I think it would be great to improve our test coverage.

Of course we might not target to 100%, but as much as possible, to the level that we can currently cover with CI.

Sub-Tasks

• CLONE - Improve the test coverage for pyspark/pandas module: Resolved
• CLONE - Improve the test coverage for pyspark/mllib module: Resolved
• CLONE - Improve the test coverage for pyspark/ml module: Resolved
• CLONE - Improve the test coverage for pyspark/sql module: Resolved
• CLONE - Improve the test coverage for pyspark/*.py: Resolved
• CLONE - Improve the test coverage for pyspark/find_spark_home.py: Resolved
• CLONE - Improve the test coverage for pyspark/statcounter.py: Resolved