Bulk Operation

SPARK-23899 High-order function: filter(array<T>, function<T, Int, boolean>) → array<T>

SPARK-23899 High-order function: exists(array<T>, function<T, boolean>) → boolean

SPARK-23899 High-order function: zip_with_index

SPARK-23899 High-order function: transform_values(map<K, V1>, function<K, V1, V2>) → map<K, V2>

SPARK-23899 High-order function: transform_keys(map<K1, V>, function<K1, V, K2>) → map<K2,V>

SPARK-23899 High-order function: map_zip_with(map<K, V1>, map<K, V2>, function<K, V1, V2, V3>) → map<K, V3>

SPARK-23899 High-order function: map_filter(map<K, V>, function<K, V, boolean>) → MAP<K,V>

SPARK-23899 High-order function: map_concat(map1<K, V>, map2<K, V>, ..., mapN<K, V>) → map<K,V>

SPARK-23899 High-order function: map_entries(map<K, V>) → array<row<K,V>>

SPARK-23899 High-order function: map_from_entries(array<row<K, V>>) → map<K,V>

SPARK-23899 High-order function: map(array<K>, array<V>) → map<K,V>

SPARK-23899 High-order function: zip_with(array<T>, array<U>, function<T, U, R>) → array<R>

SPARK-23899 High-order function: array_zip(array1, array2[, ...]) → array<row>

SPARK-23899 High-order function: slice(x, start, length) → array

SPARK-23899 High-order function: shuffle(x) → array

SPARK-23899 High-order function: sequence

SPARK-23899 High-order function: reverse(x) → array

SPARK-23899 High-order function: repeat(element, count) → array

SPARK-23899 High-order function: element_at

SPARK-23899 High-order function: cardinality(x) → bigint

SPARK-23899 High-order function: arrays_overlap(x, y) → boolean

SPARK-23899 High-order function: array_sort(x) → array

SPARK-23899 High-order function: array_remove(x, element) → array

SPARK-23899 High-order function: array_position(x, element) → bigint

SPARK-23899 High-order function: array_min(x) → x

SPARK-23899 High-order function: array_max(x) → x

SPARK-23899 High-order function: array_join(x, delimiter, null_replacement) → varchar

SPARK-23899 High-order function: array_except(x, y) → array

SPARK-23899 High-order function: array_union(x, y) → array

SPARK-23899 High-order function: array_intersect(x, y) → array

SPARK-23899 High-order function: array_distinct(x) → array

SPARK-23899 High-order function: aggregate(array<T>, initialState S, inputFunction<S, T, S>, outputFunction<S, R>) → R

SPARK-23899 High-order function: filter(array<T>, function<T, boolean>) → array<T>

SPARK-23899 High-order function: transform(array<T>, function<T, U>) → array<U>

SPARK-23899 Support regr_* functions

SPARK-23899 Add UDF trunc(numeric)

SPARK-23899 Add UDF weekday

SPARK-23899 Add support for date extract

SPARK-23899 Provide an option in months_between UDF to disable rounding-off

SPARK-23899 Data Masking Functions

SPARK-23899 format_number udf should take user specifed format as argument

SPARK-23899 High-order function: flatten(x) → array

SPARK-23899 High-order function: concat(array1, array2, ..., arrayN) → array