[STANBOL-652] Benchmark should report evaluation summary

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Commons
• Labels: benchmark evaluation
• Assignee: Unassigned
• Reporter: Pablo Mendes
• Created: 04/Jun/12 10:49
• Updated: 11/Mar/14 11:29

Description

The SBC is a nice way to perform manual inspection of the behavior of the enhancement chain for different examples in the evaluation dataset. However, for evaluations with several hundreds of examples, it would be interesting to have scores that summarize the performance for the entire
dataset. For example, precision, recall and F1. An evaluation dataset is available here in BDL: http://spotlight.dbpedia.org/download/stanbol/