[SPARK-3683] PySpark Hive query generates "NULL" instead of None

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.1.0
• Component/s: PySpark, SQL
• Target Version/s: 1.2.0
• Assignee: Davies Liu
• Reporter: Tamas Jambor
• Created: 24/Sep/14 23:42
• Updated: 29/Oct/14 10:50
• Resolved: 29/Oct/14 10:50

Description

When I run a Hive query in Spark SQL, I get the new Row object, where it does not convert Hive NULL into Python None instead it keeps it string 'NULL'.

It's only an issue with String type, works with other types.

Issue Links

• relates to: SPARK-1959 String "NULL" is interpreted as null value