Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-6025

Helper method for GradientBoostedTrees to compute validation error

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.3.0
    • 1.4.0
    • MLlib
    • None

    Description

      Create a helper method for computing the error at each iteration of boosting. This should be used post-hoc to compute the error efficiently on a new dataset.

      E.g.:

      def evaluateEachIteration(data: RDD[LabeledPoint], evaluator): Array[Double]
      

      Notes:

      • It should run in the same big-O time as predict() by keeping a running total (residual).
      • A different method name could be good.
      • It could take an evaluator and/or could evaluate using the training metric by default.

      Attachments

        Issue Links

          Activity

            People

              MechCoder Manoj Kumar
              josephkb Joseph K. Bradley
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: