Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1856 Standardize MLlib interfaces
  3. SPARK-3702

Standardize MLlib classes for learners, models

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: MLlib
    • Labels:
      None

      Description

      Summary: Create a class hierarchy for learning algorithms and the models those algorithms produce.

      This is a super-task of several sub-tasks (but JIRA does not allow subtasks of subtasks). See the "requires" links below for subtasks.

      Goals:

      • give intuitive structure to API, both for developers and for generated documentation
      • support meta-algorithms (e.g., boosting)
      • support generic functionality (e.g., evaluation)
      • reduce code duplication across classes

      Design doc for class hierarchy

        Attachments

          Issue Links

          is depended upon by

          Umbrella - An overarching type made of sub-tasks SPARK-4591 Algorithm/model parity for spark.ml (Scala)

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          New Feature - A new feature of the product, which has yet to be developed. SPARK-3507 Create RegressionLearner trait and make some currect code implement it

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3251 Clarify learning interfaces

          • Major - Major loss of function.
          • Resolved
          relates to

          Umbrella - An overarching type made of sub-tasks SPARK-10817 ML abstraction umbrella

          • Major - Major loss of function.
          • Resolved
          requires

          Sub-task - The sub-task of the issue SPARK-4789 Standardize ML Prediction APIs

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue SPARK-5995 Make ML Prediction Developer APIs public

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #3427 [Github] Pull Request #3427 (jkbradley)

            Activity

              People

              • Assignee:
                josephkb Joseph K. Bradley
                Reporter:
                josephkb Joseph K. Bradley
              • Votes:
                4 Vote for this issue
                Watchers:
                21 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: