[SPARK-35260] DataSourceV2 Function Catalog implementation

• Type: Umbrella
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.2.0
• Component/s: SQL
• Assignee: Chao Sun
• Reporter: Chao Sun
• Created: 28/Apr/21 18:30
• Updated: 13/May/22 21:48

Description

This tracks the implementation and follow-up work for V2 Function Catalog introduced in SPARK-27658

Issue Links

• is related to: SPARK-27658 Catalog API to load functions

Sub-Tasks

• Implement V2 function resolution and evaluation: Resolved
• Support static invoke for stateless UDF: Resolved
• Improve performance for ApplyFunctionExpression: Resolved
• Analyzer should set progagateNull to false for magic function invocation: Resolved
• Handle type coercion when resolving V2 functions: Resolved
• Allow passing V2 functions to data sources via V2 filters: Open
• Deterministic flag is not handled for V2 functions: Resolved