Description
Pattern matching is utilized for each call of Concat.eval, Reverse.nullSafeEval and ElementAt.nullSafeEval and thus for each record of a dataset. This could lead to a performance penalty when expression are executed in the interpreted mode. The goal of this ticket is to reduce usage of pattern matching within the mentioned "eval" methods.
Attachments
Attachments
Issue Links
- is duplicated by
-
SPARK-25470 Eval method of Concat expression should call pattern matching only once
-
- Resolved
-
- relates to
-
SPARK-23736 High-order function: concat(array1, array2, ..., arrayN) → array
-
- Resolved
-
- links to