[SPARK-8400] ml.ALS doesn't handle -1 block size

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.3.1
• Fix Version/s: 1.3.2
• Component/s: ML
• Target Version/s: 1.3.2
• Assignee: Bryan Cutler
• Reporter: Xiangrui Meng
• Shepherd: Xiangrui Meng
• Created: 16/Jun/15 20:34
• Updated: 25/Aug/15 11:37
• Resolved: 25/Aug/15 11:37

Description

Under spark.mllib, if number blocks is set to -1, we set the block size automatically based on the input partition size. However, this behavior is not preserved in the spark.ml API. If user sets -1 in Spark 1.3, it will not work, but no error messages will show.

Issue Links

• links to: [Github] Pull Request #7333 (BryanCutler)
• links to: [Github] Pull Request #8363 (BryanCutler)