[SPARK-49203] Add expression for `java.util.Arrays.binarySearch`

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: PySpark, SQL
• Labels: pull-request-available
• Assignee: Pan Bingkun
• Reporter: Ruifeng Zheng
• Created: 12/Aug/24 03:15
• Updated: 03/Sep/24 07:47
• Resolved: 03/Sep/24 06:48

Description

Add a dedicated expression 

ArrayBinarySearch(array, value) 

for binary search, the behavior should be the same as `java.util.Arrays.binarySearch`, so that we can use it to implement histogram plot in the client side (no longer need to depend on mllib's Bucketizer)

 

This expression is for internal purposes, should not be exposed to end users.

It assume the array is already sorted.

if array or value is null, returns null.

 

Issue Links

• links to: GitHub Pull Request #47741