[NUTCH-2938] Use Any23's RepositoryWriter to write structured data to Rdf4j repository

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Do
• Component/s: any23, plugin
• Assignee: Lewis John McGibbney
• Reporter: Lewis John McGibbney
• Created: 16/Jan/22 00:43
• Updated: 03/Oct/23 10:34
• Resolved: 03/Oct/23 10:34

Description

I have been running a patch which leverages Any23's RepositoryWriter (implemented as one of a number of TripleHandler's via CompositeTripleHandler) to write Any23 extractions to GraphDB. This enables us to build a content graph from data across the enterprise.
This feature is turned off by default so will not change existing Any23 behaviour. I have concerns about the performance of this patch because right now we need to create a new repository connection for each URL. This is not great so I will definitely improve on it.
PR coming up.

Issue Links

• links to: GitHub Pull Request #725