[SPARK-9246] DistributedLDAModel predict top docs per topic

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: MLlib
• Target Version/s: 1.5.0
• Assignee: Meihua Wu
• Reporter: Joseph K. Bradley
• Shepherd: Joseph K. Bradley
• Created: 22/Jul/15 07:14
• Updated: 31/Jul/15 20:01
• Resolved: 31/Jul/15 20:01

Description

For each topic, return top documents based on topicDistributions.

Synopsis:

/**
 * @param maxDocuments  Max docs to return for each topic
 * @return Array over topics of (sorted top docs, corresponding doc-topic weights)
 */
def topDocumentsPerTopic(maxDocuments: Int): Array[(Array[Long], Array[Double])]

Note: We will need to make sure that the above return value format is Java-friendly.

Issue Links

• is required by: SPARK-5572 LDA improvement listing
• links to: [Github] Pull Request #7769 (rotationsymmetry)