[SPARK-9225] LDASuite needs unit tests for empty documents

• Type: Test
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: MLlib
• Labels: starter
• Target Version/s: 1.5.0
• Assignee: Meihua Wu
• Reporter: Feynman Liang
• Shepherd: Xiangrui Meng
• Created: 21/Jul/15 18:02
• Updated: 30/Jul/15 15:52
• Resolved: 30/Jul/15 15:52

Description

We need to add a unit test to LDASuite which check that empty documents are handled appropriately without crashing. This would require defining an empty corpus within LDASuite and adding tests for the available LDA optimizers (currently EM and Online). Note that only {{SparseVector}}s can be empty.

Issue Links

• is required by: SPARK-5572 LDA improvement listing
• links to: [Github] Pull Request #7620 (rotationsymmetry)