Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-19066

SparkR LDA doesn't set optimizer correctly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.1.1, 2.2.0
    • SparkR
    • None

    Description

      spark.lda pass the optimizer "em" or "online" to the backend. However, LDAWrapper doesn't set optimizer based on the value from R. Therefore, for optimizer "em", the `isDistributed` field is FALSE, which should be TRUE.

      In addition, the `summary` method should bring back the results related to `DistributedLDAModel`.

      Attachments

        Activity

          People

            wm624 Miao Wang
            wm624 Miao Wang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: