[SPARK-35705] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: PySpark
• Assignee: Apache Spark
• Reporter: Xinrong Meng
• Created: 09/Jun/21 22:50
• Updated: 12/Dec/22 18:10
• Resolved: 10/Jun/21 01:37

Description

Adjust pandas-on-spark test_groupby_multiindex_columns test in order to pass with different pandas versions.

pandas had introduced bugs as below:

• For pandas 1.1.3 and 1.1.4

Type error: only integer scalar arrays can be converted to a scalar index

• For pandas < 1.0.4

Type error: Can only tuple-index with a MultiIndex

Issue Links

• links to: [Github] Pull Request #32851 (xinrong-databricks)