[KAFKA-10380] Make dist flatten rocksdbjni

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.6.0
• Component/s: build
• Assignee: Unassigned
• Reporter: Adrian Cole
• Created: 10/Aug/20 03:32
• Updated: 20/Aug/20 18:17

Description

I was looking for ways to reduce the size of our Kafka image, and the most notable opportunity is handling rocksdbjni differently. It is currently a 15MB jar.

As mentioned in its description rocksdbjni includes binaries for a lot of OS choices.

du k librocksdbjni*
7220 librocksdbjni-linux-aarch64.so
8756 librocksdbjni-linux-ppc64le.so
7220 librocksdbjni-linux32.so
7932 librocksdbjni-linux64.so
5440 librocksdbjni-osx.jnilib
4616 librocksdbjni-win64.dll

It may not seem obvious in normal dists, which aim to work for many operating systems what is a problem here. When creating docker images, we currently would need to repackage this to scrub out the irrelevant OS items or accept files larger than alpine itself.

While this might be something to kick back to rocksdb. having some options here would be great.