[SPARK-28227] Spark can’t support TRANSFORM with aggregation

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: angerszhu
• Reporter: angerszhu
• Created: 02/Jul/19 05:00
• Updated: 13/Apr/21 09:40
• Resolved: 13/Apr/21 02:36

Description

Spark can;t support using TRANSFORM with aggregation such as :

SELECT TRANSFORM(T.A, SUM(T.B))
USING 'func' AS (X STRING Y STRING)
FROM DEFAULT.TEST T
WHERE T.C > 0
GROUP BY T.A

Issue Links

• is related to: SPARK-15694 Implement ScriptTransformation in sql/core
• links to: [Github] Pull Request #29087 (AngersZhuuuu)
• links to: [Github] Pull Request #29087 (AngersZhuuuu)
• links to: [Github] Pull Request #32149 (AngersZhuuuu)
• links to: [Github] Pull Request #32149 (AngersZhuuuu)
• links to: GitHub Pull Request #25028