Description
LDA was implemented with extensibility in mind. And with the development of OnlineLDA and Gibbs Sampling, we are collecting more detailed requirements from different algorithms.
As Joseph Bradley proposed in https://github.com/apache/spark/pull/4807 and with some further discussion, we'd like to adjust the code structure a little to present the common interface and extension point clearly.
Basically class LDA would be a common entrance for LDA computing. And each LDA object will refer to a LDAOptimizer for the concrete algorithm implementation. Users can customize LDAOptimizer with specific parameters and assign it to LDA.
Attachments
Issue Links
- duplicates
-
SPARK-7089 Introduce LDAOptimizer to LDA to improve extensibility
-
- Closed
-
- is part of
-
SPARK-5572 LDA improvement listing
-
- Resolved
-
- links to
