[SPARK-43926] Add array_agg, array_size, cardinality, count_min_sketch,mask,named_struct,json_* to Scala and Python

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0
• Component/s: Connect, PySpark, SQL
• Assignee: Tengfei Huang
• Reporter: Ruifeng Zheng
• Created: 02/Jun/23 01:25
• Updated: 30/Jun/23 05:36
• Resolved: 30/Jun/23 05:36

Description

Add array_agg, array_size, cardinality, count_min_sketch

Add following functions:

• array_agg
• array_size
• cardinality
• count_min_sketch
• named_struct
• json_array_length
• json_object_keys
• mask

to:

• Scala API
• Python API
• Spark Connect Scala Client
• Spark Connect Python Client

Issue Links

• links to: [Github] Pull Request #41718 (ivoson)