Details
-
Wish
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
1.6.0
-
Any
Description
A framework for integrating/linking external data to named entities. For instance, geocoding or georeferencing location entities to geonames gazateers can be implemented as an EntityLinker. Initially created ticket to specifically solve the georeferencing/geolocating/geotagging problem, but the framework should allow linkage of any external data to any entity type. Commercial applications that do this are expensive, and there are many free gazateers one could use to create solutions with OpenNLP.
UPDATE: The current implementation of the GeoEntityLinker uses Lucene to store the Gazateers, and provides utils for indexing them. The impl returns lat, long (and other gaz fields) for toponyms extracted with NER.
All extracted toponyms are scored in four ways: fuzzy string matching, binning by location, context modeling, and country-mention proximity. These scores enable a good means of deciding what's worth keeping from the gaz.