Description
Pattern matching is utilized for each call of Concat.eval, Reverse.nullSafeEval and ElementAt.nullSafeEval and thus for each record of a dataset. This could lead to a performance penalty when expression are executed in the interpreted mode. The goal of this ticket is to reduce usage of pattern matching within the mentioned "eval" methods.
Attachments
Issue Links
- is duplicated by
-
SPARK-25470 Eval method of Concat expression should call pattern matching only once
-
- Resolved
-
- relates to
-
SPARK-23736 High-order function: concat(array1, array2, ..., arrayN) → array
-
- Resolved
-
- links to