[SPARK-6820] Convert NAs to null type in SparkR DataFrames

• Type: New Feature
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.4.1, 1.5.0
• Component/s: SparkR
• Target Version/s: 1.4.1
• External issue URL: https://sparkr.atlassian.net/browse/SPARKR-232
• Assignee: Qian Huang
• Reporter: Shivaram Venkataraman
• Created: 09/Apr/15 21:05
• Updated: 09/Jun/15 04:40
• Resolved: 09/Jun/15 04:40

Description

While converting RDD or local R DataFrame to a SparkR DataFrame we need to handle missing values or NAs.
We should convert NAs to SparkSQL's null type to handle the conversion correctly

Issue Links

• links to: [Github] Pull Request #6190 (hqzizania)