[STANBOL-1211] Improve Chunk support for Entitylinking

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Component/s: Enhancement Engines
• Assignee: Rupert Westenthaler
• Reporter: Rupert Westenthaler
• Created: 18/Nov/13 10:57
• Updated: 21/Nov/13 08:19
• Resolved: 21/Nov/13 08:19

Description

Both the EntityLinkingEngine as well as the LuceneFstLinkingEngine do currently not use Chunk information very well. For now Chunks are only used to also lookup multiple matchable tokens in the same chunk with the Vocabulary - to increase recall in case proper-noun linking is enabled.

However chunks can also be useful to increase precision by using the span of the Chunk as a base for calculating the confidence of the linked Entity.

A typical example are suggestions for Persons Names: If a text mentions the Given and Family name of a Person not present in an vocabulary the Entitylinking may suggest Entities just matching on of the two names with a 100% confidence. When using the span of the Chunk such suggestions would be omitted as the minimum label match score is typically > 50%.

Other example include matches for "US

{OrgName}" where "US" is linked when the whole organization is not found; same with "{OrgName}

{Role}" where the {Role}

(e.g. president) is linked; Also cases like "15. September, 2013" may cause September to be suggested if present in the vocabulary.