[CONNECTORS-1500] HTML Extractor transformation connector contribution

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: ManifoldCF 2.9.1
• Fix Version/s: ManifoldCF 2.10
• Assignee: Karl Wright
• Reporter: Olivier Tavard
• Created: 15/Mar/18 14:50
• Updated: 10/May/19 19:35
• Resolved: 05/May/18 09:59

Description

Hi,

I developed a transformation connector based on Jsoup. The goal of this code is to simply choose an encompassing tag in a HTML document for text extracting. And inside this tag, this connector allows you to remove subparts that you do no want : all the tags corresponding to declared types or specific attribute tag names for example.
The code is in Apache V2 licence  and it is in attachment.

It needs some work including code refactoring, renaming classes, unit tests that I will be able to do if you are interested by the code.
The documentation is here :

https://datafari.atlassian.net/wiki/spaces/DATAFARI/pages/237240321/HTML+Extractor+Transformation+connector<https://datafari.atlassian.net/wiki/spaces/DATAFARI/pages/237240321/HTML+Extractor+Transformation+connector

 

It does not use additional libraries that the ones already present in MCF project. It is based on Jsoup library on lib folder.

Best regards,

Olivier

Issue Links

• is cloned by: CONNECTORS-1605 Update HTML Extractor connector