[NUTCH-2891] Upgrade to Tika 2.1

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.18
• Fix Version/s: 1.19
• Component/s: parser, plugin
• Assignee: Sebastian Nagel
• Reporter: Sebastian Nagel
• Created: 17/Sep/21 11:22
• Updated: 13/Mar/24 14:51
• Resolved: 01/Dec/21 09:11

Description

There's already the second release of Tika 2 (2.1.0). Following the 2.0 release notes and the migration guide:

• Tika 2 is more modular which should allow us to build a smaller parse-tika (66 MiB in the 1.18 binary package) by dropping rarely used parsers - but users should be able to include them if they build Nutch from the sources.
• the language-identifier plugin needs to be upgraded as well (in addition to Nutch core and the parse-tika plugin). This would include or overlap with NUTCH-2449.
• to avoid that the PDF parser times out we probably want to disable the OCR by default, or at least, provide the configuration snippet for this purpose

Issue Links

• incorporates: NUTCH-2449 Usage of Tika LanguageIdentifier in language-identifier plugin
• supercedes: NUTCH-2860 Upgrade to Tika 1.26
• links to: GitHub Pull Request #700