[TIKA-3676] Consider making dl4j dependencies provided

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.4.0
• Assignee: Unassigned
• Reporter: Tim Allison
• Created: 09/Feb/22 14:29
• Updated: 18/Mar/22 20:51
• Resolved: 11/Feb/22 11:29

Description

Dl4j dependencies are rather large. We can cut ~4-6 minutes off the build time and prevent gigabytes transferring over various networks during the release cycle (at least). With the recent upgrade to dl4j, the jar is now 1.4GB, up from ~800MB in our 1.x branch.

We are currently packaging the kitchen-sink, e.g. every platform's native libraries. For folks using our wrappers/parsers around dl4j, they can a) easily include the dependencies that are "provided" or b) tailor their dependencies for their OS/architecture.

What do you think?