[SPARK-46427] Change Python Data Source's description to be pretty in explain

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: PySpark, SQL
• Labels: pull-request-available
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 16/Dec/23 02:06
• Updated: 16/Dec/23 06:02
• Resolved: 16/Dec/23 06:02

Description

Now it's as below:

== Physical Plan ==
*(1) Project [x#0, y#1]
+- BatchScan test[x#0, y#1] class org.apache.spark.sql.execution.python.PythonTableProvider$$anon$1$$anon$2 RuntimeFilters: []

Issue Links

• links to: GitHub Pull Request #44379