[OPENNLP-579] Framework to dynamically link N-best matches from external data to named entities by type (EntityLinker framework)

• Type: Wish
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: Entity Linker
• Labels: features
• Environment: Any
• Assignee: Jörn Kottmann
• Reporter: Mark Giaconia
• Created: 21/May/13 23:14
• Updated: 20/Nov/14 16:30
• Resolved: 20/Nov/14 16:30

Description

A framework for integrating/linking external data to named entities. For instance, geocoding or georeferencing location entities to geonames gazateers can be implemented as an EntityLinker. Initially created ticket to specifically solve the georeferencing/geolocating/geotagging problem, but the framework should allow linkage of any external data to any entity type. Commercial applications that do this are expensive, and there are many free gazateers one could use to create solutions with OpenNLP.
UPDATE: The current implementation of the GeoEntityLinker uses Lucene to store the Gazateers, and provides utils for indexing them. The impl returns lat, long (and other gaz fields) for toponyms extracted with NER.
All extracted toponyms are scored in four ways: fuzzy string matching, binning by location, context modeling, and country-mention proximity. These scores enable a good means of deciding what's worth keeping from the gaz.

Sub-Tasks

• GeoEntityLinker does not provide a method for setting the properties file location in order to get the database connection, it is currently hard coded: Closed
• EntityLinker framework should provide the means to return multiple types of scores for linkedspans: Closed
• EntityLinkerProperties should support String path, and InputStream as input: Closed
• EntityLinkerFactory should return one EntityLinker for simplicity: Closed
• Move GeoEntityLinker to Addons in Sandbox. Leave EntityLinker fwk in tools: Closed
• GeoEntityLinker should score toponyms based on surrounding context via a model: Closed
• GeoEntityLinker should use proper Lucene language Analyzers on NGA Geonames: Closed
• GeoEntityLinker should dedupe entries returned from Gazateers: Closed
• EntityLinker setEntityLinkerProperties should throw Exception and be renamed to init(props): Closed
• GazateerSearcher cacheing the wrong value: Closed