[SOLR-16010] langid should include all required Tika dependencies

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Component/s: contrib - LangId
• Assignee: Unassigned
• Reporter: Kevin Risden
• Created: 15/Feb/22 13:58
• Updated: 12/May/22 00:35
• Resolved: 15/Feb/22 14:40

Description

Currently, the langid module requires that extraction module to be loaded for langid to work. It isn't clear if what is included in the extraction module will even meet the langid needs (ie: tika-langdetect isn't included in extraction module)

➜  solr git:(SOLR-15989) find solr/packaging/build/solr-10.0.0-SNAPSHOT/ -name '*tika*.jar'
solr/packaging/build/solr-10.0.0-SNAPSHOT/modules/langid/lib/tika-core-1.27.jar
solr/packaging/build/solr-10.0.0-SNAPSHOT/modules/extraction/lib/tika-parsers-1.27.jar
solr/packaging/build/solr-10.0.0-SNAPSHOT/modules/extraction/lib/tika-java7-1.27.jar
solr/packaging/build/solr-10.0.0-SNAPSHOT/modules/extraction/lib/tika-xmp-1.27.jar
solr/packaging/build/solr-10.0.0-SNAPSHOT/modules/extraction/lib/vorbis-java-tika-0.8.jar
solr/packaging/build/solr-10.0.0-SNAPSHOT/modules/extraction/lib/tika-core-1.27.jar

This came out of a discussion in SOLR-15989 - https://github.com/apache/solr/pull/621#discussion_r806083202

Issue Links

• relates to: SOLR-15989 Upgrade to Tika 1.28.1