Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20768

PySpark FPGrowth does not expose numPartitions (expert) param

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.2.0
    • 2.2.0
    • ML, PySpark
    • None

    Description

      The PySpark API for FPGrowth does not expose the numPartitions param. While it is an "expert" param, the general approach elsewhere is to expose these on the Python side (e.g. aggregationDepth and intermediate storage params in ALS)

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue SPARK-19281 spark.ml Python API for FPGrowth

          • Major - Major loss of function.
          • Resolved
          is required by

          Sub-task - The sub-task of the issue SPARK-20503 ML 2.2 QA: API: Python API coverage

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Pull request #18058 [Github] Pull Request #18058 (facaiy)

          Activity

            People

              facai Yan Facai (颜发才)
              mlnick Nicholas Pentreath
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: