[STANBOL-632] Add post-processing EnhancementEngine for rule based adding of fise:confidence-level information

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Enhancer
• Assignee: Rupert Westenthaler
• Reporter: Rupert Westenthaler
• Created: 26/May/12 08:03
• Updated: 02/May/13 02:29

Description

It is expected that not all EnhancementEngines will initially support the fise:confidence-level feature.

This engine would use (implement) the following default rule set

• ignore Enhancements with an existing "confidence-level" assignment
• TextAnnotations with a confidence value > 0.8 => confident
• TextAnnotations with a confidence value < 0.8 > 0.5 => suggestion
• TextAnnotations with a confidence value < 0.5 => uncertain
• TextAnnotations with a single linked EntityAnnotation with a
  confidence > 0.8 => confident
• TextAnnotations with a several linked EntityAnnotation with a
  confidence > 0.8 => ambiguous *)
• TextAnnotations with several linked EntityAnnotations with a
  confidence > 0.5 but no one > 0.8 => ambiguous *)
• TextAnnotations with a single linked EntityAnnotation with a
  confidence < 0.8 > 0.5 => suggestion
• TextAnnotations with EntityAnnotations with confidence values < 0.5
  => uncertain
• TopicAnnotation with a confidence value > 0.8 => confident
• TopicAnnotation with a confidence value < 0.8 > 0.5 => suggestion
• TopicAnnotation with a confidence value < 0.5 => uncertain

*) NOTE that in those cases only EntityAnnotations with a confidence
value > 0.5 would be marked as "ambiguous". Additional
EntityAnnotations with confidence values < 0.5 would be marked as
"uncertain"

In addition the configuration should allow users to configure what Enhancement should be processed by
defining

• Enhancement type (enable/disable TextAnnotations, EntityAnnotations, TopicAnnotations)
• Enhancements of Engines (enable/disable based on Engine names)
• Set the ranges for "confident" (default >= 0,8); "suggestion" (default >=0,5 <0,8); uncertain (default < 0,5)

Issue Links

• depends upon: STANBOL-630 Confidence values MUST BE in the range [0..1]