[SPARK-22586] Feature selection

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Invalid
• Affects Version/s: 2.2.0
• Component/s: ML
• Assignee: Unassigned
• Reporter: Jorge Gonzalez Lopez
• Created: 22/Nov/17 22:20
• Updated: 22/Nov/17 22:49
• Resolved: 22/Nov/17 22:44

Description

Hello everyone,

I would like to know if there are plans to add different score functions to perform feature selection under the same interface. I saw two previous issues related to the topic:

https://issues.apache.org/jira/browse/SPARK-6531
https://issues.apache.org/jira/browse/SPARK-1473

However, it seems nothing was added at the end. I would like to know if there was some problem then, because I wouldn't mind taking a closer look to it in case people would be interested.

Additionally, I think it would be interested to include a score metric between continuous attributes (for regression), and between continuous and discrete (for classification). This has already been done successfully on http://scikit-learn.org/stable/modules/feature_selection.html#univariate-feature-selection