Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-14045

DecisionTree improvement umbrella

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • ML

    Description

      This is an umbrella for improvements to decision tree learning. This includes:

      • DecisionTreeClassifier
      • DecisionTreeRegressor
      • aspects of tree ensembles specific to learning individual trees, i.e., issues which will also affect DecisionTreeClassifier/Regressor

      Attachments

        Issue Links

          contains

          Bug - A problem which impairs or prevents the functions of the product. SPARK-34591 Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to diagnose and impossible to correct

          • Major - Major loss of function.
          • In Progress

          New Feature - A new feature of the product, which has yet to be developed. SPARK-19591 Add sample weights to decision trees

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-15699 Add chi-squared test statistic as a split quality metric for decision trees

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3162 Train DecisionTree locally when possible

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3717 DecisionTree, RandomForest: Partition by feature

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-12301 Remove final from classes in spark.ml trees and ensembles where possible

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-14351 Optimize ImpurityAggregator for decision trees

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-22451 Reduce decision tree aggregate size for unordered features from O(2^numCategories) to O(numCategories)

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3155 Support DecisionTree pruning

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3159 Check for reducible DecisionTree

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3165 DecisionTree does not use sparsity in data

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3380 DecisionTree: overflow and precision in aggregation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3383 DecisionTree aggregate size could be smaller

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-3723 DecisionTree, RandomForest: Add more instrumentation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-14043 Remove restriction on maxDepth for decision trees

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16957 Use weighted midpoints for split values.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Test - A new unit, integration or system test. SPARK-14216 ML tree models should have a standardized, reusable feature importance test

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Umbrella - An overarching type made of sub-tasks SPARK-14046 RandomForest improvement umbrella

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-14047 GBT improvement umbrella

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              josephkb Joseph K. Bradley
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: