[SPARK-6177] Add note in LDA example to remind possible coalesce

• Type: Improvement
• Status: Closed
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 1.2.1
• Fix Version/s: 1.4.0
• Component/s: Examples, MLlib
• Assignee: yuhao yang
• Reporter: yuhao yang
• Created: 05/Mar/15 05:16
• Updated: 11/Mar/15 02:09
• Resolved: 10/Mar/15 10:52

Description

Add comment to introduce coalesce to LDA example to avoid the possible massive partitions from sc.textFile.

sc.textFile will create RDD with one partition for each file, and the possible massive partitions downgrades LDA performance.

Issue Links

• links to: [Github] Pull Request #4899 (hhbyyh)