Uploaded image for project: 'Stanbol'
  1. Stanbol
  2. STANBOL-652

Benchmark should report evaluation summary

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Commons

      Description

      The SBC is a nice way to perform manual inspection of the behavior of the enhancement chain for different examples in the evaluation dataset. However, for evaluations with several hundreds of examples, it would be interesting to have scores that summarize the performance for the entire
      dataset. For example, precision, recall and F1. An evaluation dataset is available here in BDL: http://spotlight.dbpedia.org/download/stanbol/

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              pablomendes Pablo Mendes
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: