Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-941

Improve ConfusionMatrix statistics

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.8
    • None
    • None

    Description

      This patch adds more statistics to the ConfusionMatrix and RequestAnalyzer.

      1. Add Kappa measure - a standard measure comparing a sample v.s. random assignment.
      2. Add mean & standard deviation of "Reliability" (User Accuracy) - assist in identifying consistent mal-assignment against "good" and "bad" labels.

      Attachments

        1. SGD.zip
          2 kB
          Lance Norskog
        2. MAHOUT-941.patch
          14 kB
          Lance Norskog
        3. MAHOUT-941.patch
          22 kB
          Lance Norskog
        4. MAHOUT-941.patch
          13 kB
          Lance Norskog
        5. Bayes.zip
          2 kB
          Lance Norskog

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. MAHOUT-939 ASF Email Classification Examples don't always produce good results

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            robinanil Robin Anil
            lancenorskog Lance Norskog
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment