[SPARK-6119] DataFrame.dropna support

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.1, 1.4.0
• Component/s: SQL
• Labels: DataFrame
• Sprint: Spark 1.5 doc/QA sprint
• Assignee: Reynold Xin
• Reporter: Reynold Xin
• Created: 02/Mar/15 21:43
• Updated: 31/Mar/15 03:47
• Resolved: 31/Mar/15 03:47

Description

Support dropping rows with null values (dropna). Similar to Pandas' dropna

http://pandas.pydata.org/pandas-docs/dev/generated/pandas.DataFrame.dropna.html

Issue Links

• links to: [Github] Pull Request #5225 (rxin)
• links to: [Github] Pull Request #5248 (rxin)
• links to: [Github] Pull Request #5274 (rxin)