Description
Several performance improvement for ChiSqSelector:
1, Keep selectedFeatures ordered ascendent.
ChiSqSelectorModel.transform need selectedFeatures ordered to make prediction. We should sort it when training model rather than making prediction, since users usually train model once and use the model to do prediction multiple times.
2, When training fpr type ChiSqSelectorModel, it's not necessary to sort the ChiSq test result by statistic.
Attachments
Issue Links
- is depended upon by
-
SPARK-17645 Add feature selector methods based on: False Discovery Rate (FDR) and Family Wise Error rate (FWE)
-
- Resolved
-
- links to
