[SPARK-23690] VectorAssembler should have handleInvalid to handle columns with null values

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.4.0
• Component/s: ML
• Assignee: yogesh garg
• Reporter: yogesh garg
• Shepherd: Joseph K. Bradley
• Created: 15/Mar/18 02:31
• Updated: 02/Apr/18 23:42
• Resolved: 02/Apr/18 23:42

Description

VectorAssembler only takes in numeric (and vectors (of numeric?)) columns as an input and returns the assembled vector. It currently throws an error if it sees a null value in any column. This behavior also affects `RFormula` that uses VectorAssembler to assemble numeric columns.

Issue Links

• links to: [Github] Pull Request #20829 (yogeshg)