[SPARK-38107] Use error classes in the compilation errors of python/pandas UDFs

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: Haejoon Lee
• Reporter: Max Gekk
• Shepherd: Max Gekk
• Created: 04/Feb/22 16:32
• Updated: 12/Dec/22 18:10
• Resolved: 11/Mar/22 10:13

Description

Migrate the following errors in QueryCompilationErrors:

• pandasUDFAggregateNotSupportedInPivotError
• groupAggPandasUDFUnsupportedByStreamingAggError
• cannotUseMixtureOfAggFunctionAndGroupAggPandasUDFError
• usePythonUDFInJoinConditionUnsupportedError

onto use error classes. Throw an implementation of SparkThrowable. Also write a test per every error in QueryCompilationErrorsSuite.

Issue Links

• Blocked: SPARK-38235 Add test util for testing grouped aggregate pandas UDF.
• links to: [Github] Pull Request #35656 (itholic)
• links to: [Github] Pull Request #36113 (itholic)