Uploaded image for project: 'Jackrabbit Oak'
  1. Jackrabbit Oak
  2. OAK-6317

LMSEstimator update amount depending on cost amount

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.6.1, 1.7.1, 1.4.16, 1.2.26
    • 1.7.3, 1.6.2, 1.2.27, 1.4.17, 1.8.0
    • solr
    • None

    Description

      LMSEstimator update rule implementation wrongly updates the weights taking the LMS cost value into account, this means that if the error is huge (and the cost quadratically grows with it) the weight could get an update value almost proportional to the LMS value (smoothed by learning rate alpha).
      The correct update rule should be used which only uses the residual.

      The side effect of this bug is that:

      • cost may vary a lot
      • weights could not converge to a good solution

      Attachments

        Activity

          People

            teofili Tommaso Teofili
            teofili Tommaso Teofili
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: