[SPARK-2777] ALS factors should be persist in memory and disk

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.1.0
• Component/s: MLlib
• Target Version/s: 1.1.0
• Assignee: Xiangrui Meng
• Reporter: Xiangrui Meng
• Created: 31/Jul/14 20:11
• Updated: 01/Aug/14 04:14
• Resolved: 01/Aug/14 04:14

Description

Now the factors are persisted in memory only. If they get kicked off by later jobs, we have to start the computation from very beginning. A better solution should be changing the storage level to MEMORY_AND_DISK.

Issue Links

• links to: [Github] Pull Request #1700 (mengxr)