[SPARK-24313] Collection functions interpreted execution doesn't work with complex types

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.1, 2.4.0
• Component/s: SQL
• Labels: correctness
• Assignee: Marco Gaido
• Reporter: Marco Gaido
• Created: 18/May/18 09:15
• Updated: 23/May/18 14:27
• Resolved: 22/May/18 13:09

Description

Several functions working on collection return incorrect result for complex data types in interpreted mode. In particular, we consider comple data types BINARY, ARRAY. The list of the affected functions is: array_contains, array_position, element_at and GetMapValue.

Issue Links

• links to: [Github] Pull Request #21361 (mgaido91)
• links to: [Github] Pull Request #21403 (mgaido91)
• links to: [Github] Pull Request #21407 (mgaido91)