[SPARK-23302] Refactor group aggregate pandas UDF to its own catalyst rules

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.4.0
• Component/s: PySpark
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Li Jin
• Created: 01/Feb/18 15:17
• Updated: 25/May/21 01:51
• Resolved: 25/May/21 01:39

Description

Per discussion on https://github.com/apache/spark/pull/19872#discussion_r165220142

We should try to refactor group aggregate pandas UDF to its own catalyst rules