[SPARK-50119] UnresolvedException thrown instead of INVALID_LAMBDA_FUNCTION_CALL.NON_HIGHER_ORDER_FUNCTION

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Later
• Affects Version/s: 4.0.0
• Component/s: Spark Core
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Dusan Tisma
• Created: 25/Oct/24 13:24
• Updated: 28/Oct/24 17:21
• Resolved: 28/Oct/24 17:21

Description

Lambdas in non-higher order functions throw 

INVALID_LAMBDA_FUNCTION_CALL.NON_HIGHER_ORDER_FUNCTION

, however this is only thrown from other functions, and not for all cases:

select if(x -> x = 2, 10, 20)

 throws 

INVALID_LAMBDA_FUNCTION_CALL.NON_HIGHER_ORDER_FUNCTION

, but

select if(not x -> x = 2, 10, 20) 

throws 

UnresolvedException

The user error in the latter case needs improvement

Issue Links

• links to: GitHub Pull Request #48658