[SPARK-41653] Test parity: enable doctests in Spark Connect

• Type: Umbrella
• Status: Resolved
• Priority: Major
• Resolution: Done
• Affects Version/s: 3.4.0
• Component/s: Connect
• Epic Link: Spark Connect
• Assignee: Sandeep Singh
• Reporter: Hyukjin Kwon
• Created: 21/Dec/22 07:22
• Updated: 03/Jan/23 04:40
• Resolved: 03/Jan/23 04:40

Description

We should actually run the doctests of Spark Connect.

We should add something like https://github.com/apache/spark/blob/master/python/pyspark/sql/column.py#L1227-L1247 to Spark Connect modules, and add the module into https://github.com/apache/spark/blob/master/dev/sparktestsupport/modules.py#L507

Issue Links

• is part of: SPARK-41285 Test basework and improvement of test coverage in Spark Connect

Sub-Tasks

• Enable doctests in pyspark.sql.connect.window: Resolved
• Enable doctests in pyspark.sql.connect.column: Resolved
• Enable doctests in pyspark.sql.connect.dataframe: Resolved
• Enable doctests in pyspark.sql.connect.session: Resolved
• Enable doctests in pyspark.sql.connect.functions: Resolved
• Enable doctests in pyspark.sql.connect.readwriter: Resolved
• Enable doctests in pyspark.sql.connect.group: Resolved
• Enable doctests in pyspark.sql.connect.catalog: Resolved
• Enable doctests in connect.column and connect.functions: Resolved