[SPARK-8803] Crosstab element's can't contain null's and back ticks

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.1, 1.5.0
• Component/s: SQL
• Target Version/s: 1.4.1
• Assignee: Burak Yavuz
• Reporter: Burak Yavuz
• Created: 02/Jul/15 22:40
• Updated: 03/Feb/19 20:56
• Resolved: 03/Jul/15 05:13

Description

Having back ticks or null as elements causes problems.

Since elements become column names, we have to drop them from the element as back ticks are special characters.

Having null throws exceptions, we could replace them with empty strings.

Issue Links

• is related to: SPARK-8621 crosstab exception when one of the value is empty
• links to: [Github] Pull Request #7201 (brkyvz)
• links to: [Github] Pull Request #7295 (JoshRosen)
• links to: GitHub Pull Request #7201