Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
Modify SpotLDAWrapper object to decouple functionality.
- Create new object SpotLDAModel as a wrapper for Spark DistributedModel and LocalModel that can Save or Predict (only LocalModel).
- Create new object SpotLDAHelper that can format LDA corpus, topicDistribution and topicMix.
- Create new object SpotLDAResults that contains 2 attributes, one is the document distribution over topics and another one for word distribution over topics required for spot-ml scoring.
- Modify SpotLDAWrapper to be able to run or load, when run method is executed, run LDA and return a new SpotLDAModel. When load method is executed, load an existing model.
Attachments
Attachments
Issue Links
- links to