[SPARK-43295] Make DataFrameGroupBy.sum support for string type columns

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Pandas API on Spark
• Labels: pull-request-available
• Assignee: Haejoon Lee
• Reporter: Haejoon Lee
• Created: 26/Apr/23 16:06
• Updated: 11/Sep/23 05:06
• Resolved: 11/Sep/23 05:06

Description

From pandas 2.0.0, DataFrameGroupBy.sum also works for string type columns:

>>> psdf
   A    B  C      D
0  1  3.1  a   True
1  2  4.1  b  False
2  1  4.1  b  False
3  2  3.1  a   True
>>> psdf.groupby("A").sum().sort_index()
     B  D
A
1  7.2  1
2  7.2  1
>>> psdf.to_pandas().groupby("A").sum().sort_index()
     B   C  D
A
1  7.2  ab  1
2  7.2  ba  1 

Issue Links

• links to: GitHub Pull Request #42798