[STANBOL-187] Extendable indexing infrastructure for the Entityhub

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0-incubating
• Component/s: Entityhub
• Assignee: Rupert Westenthaler
• Reporter: Rupert Westenthaler
• Created: 29/Apr/11 09:02
• Updated: 06/Mar/14 17:58
• Resolved: 05/Mar/12 20:15

Description

Currently the Entityhub includes some utilities to create Indexes for dbPedia, geonames and dblp. There exists also an generic RDF indexer that is used by the dbPedia and dblp however also this implementation is not extendable and not really suitable to add features requested by issues like STANBOL-92, STANBOL-93 and STANBOL-163.

The goal is to create an infrastructure that provides an implementation of

• the indexing workflow
• configuration and initialization
  and defines Interfaces that allows to plug in
• different Data Sources
• entity ranking implementations
• entity data mapper (e.g. filtering some fields, schema translations ...)
• indexing targets (the Yard that stores the indexed entities)

The existing Indexing utilities need to be moved to use the new Infrastructure

Issue Links

• relates to: STANBOL-1295 YAGO Integration in Stanbol
• relates to: STANBOL-835 Porting of the geonames.org indexer to the Entityhub Indexing Tool