[SPARK-47256] Assign error classes to FILTER expression errors

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available starter
• Assignee: David Milicevic
• Reporter: Max Gekk
• Shepherd: Max Gekk
• Created: 03/Mar/24 12:59
• Updated: 26/Mar/24 08:46
• Resolved: 25/Mar/24 17:21

Description

Choose a proper name for the error class _LEGACY_ERROR_TEMP_102[4-7] defined in common/utils/src/main/resources/error/error-classes.json. The name should be short but complete (look at the example in error-classes.json).

Add a test which triggers the error from user code if such test still doesn't exist. Check exception fields by using checkError(). The last function checks valuable error fields only, and avoids dependencies from error text message. In this way, tech editors can modify error format in error-classes.json, and don't worry of Spark's internal tests. Migrate other tests that might trigger the error onto checkError().

If you cannot reproduce the error from user space (using SQL query), replace the error by an internal error, see SparkException.internalError().

Improve the error message format in error-classes.json if the current is not clear. Propose a solution to users how to avoid and fix such kind of errors.

Please, look at the PR below as examples:

• https://github.com/apache/spark/pull/38685
• https://github.com/apache/spark/pull/38656
• https://github.com/apache/spark/pull/38490

Issue Links

• is a clone of: SPARK-47255 Assign names to the error classes _LEGACY_ERROR_TEMP_324[7-9]
• is cloned by: SPARK-47257 Assign error classes to ALTER COLUMN errors
• links to: GitHub Pull Request #45622