[SPARK-21719] Enable complex expression in Column.getItem(...)

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.2.0
• Component/s: SQL
• Labels: SQL bulk-closed
• Assignee: Unassigned
• Reporter: Dean Gurvitz
• Created: 13/Aug/17 14:40
• Updated: 21/May/19 04:11
• Resolved: 21/May/19 04:11

Description

Currently, the Column.getItem(...) method supports only String or number literals. However, one might want to provide a more complicated expression, such as get the item at the index specified by another column, or the item at an index which is specified by a UDF call. Currently, there is no way to do that.

Creating an overload for the getItem(...) method which accepts a Column object can be one solution.