[SPARK-35537] Introduce a util function to check whether the underlying expressions of the columns are the same.

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: PySpark
• Assignee: Takuya Ueshin
• Reporter: Takuya Ueshin
• Created: 26/May/21 18:48
• Updated: 12/Dec/22 18:10
• Resolved: 27/May/21 03:15

Description

In pandas on Spark, there are some places checking the underlying expressions of columns are the same or not, but it's done one-by-one. We should introduce a util function for it.

Issue Links

• relates to: SPARK-34849 SPIP: Support pandas API layer on PySpark
• links to: [Github] Pull Request #32680 (ueshin)