[SPARK-9658] ML 1.5 QA: API: Binary incompatible changes

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Done
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.0
• Component/s: ML, MLlib
• Target Version/s: 1.5.0
• Assignee: Xiangrui Meng
• Reporter: Xiangrui Meng
• Created: 05/Aug/15 22:51
• Updated: 11/Nov/15 18:09
• Resolved: 19/Aug/15 18:52

Description

Generated a list of binary incompatible changes using MiMa and filter out some false positives:

1. LDA.docConcentration

It will be nice to keep the old APIs unchanged. For example, we can use “asymmetricDocConcentration”. Then “getDocConcentration" would return the first item if the concentration vector is a constant vector.

2. LDAModel.gammaShape / topicConcentration

Should be okay if we assume that no one extends LDAModel.

3. Params.setDefault

If we have time to investigate this issue. We should put it back.

4. LogisticRegressionModel.threshold is missing.

5. LogisticRegression.setThreshold shouldn't be in the Params trait. We need to override it anyway.

Will create sub-tasks for each item.

Issue Links

• is related to: SPARK-11601 ML 1.6 QA: API: Binary incompatible changes
• is related to: SPARK-9788 LDA docConcentration, gammaShape 1.5 binary incompatibility fixes
• is related to: SPARK-9789 Reinstate LogisticRegression threshold Param
• relates to: SPARK-9706 List Binary and Source Compatibility Issues with japi-compliance checker