Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-10380

Make dist flatten rocksdbjni

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.6.0
    • Fix Version/s: None
    • Component/s: build
    • Labels:
      None

      Description

      I was looking for ways to reduce the size of our Kafka image, and the most notable opportunity is handling rocksdbjni differently. It is currently a 15MB jar.

      As mentioned in its description rocksdbjni includes binaries for a lot of OS choices.

      du k librocksdbjni*
      7220 librocksdbjni-linux-aarch64.so
      8756 librocksdbjni-linux-ppc64le.so
      7220 librocksdbjni-linux32.so
      7932 librocksdbjni-linux64.so
      5440 librocksdbjni-osx.jnilib
      4616 librocksdbjni-win64.dll

      It may not seem obvious in normal dists, which aim to work for many operating systems what is a problem here. When creating docker images, we currently would need to repackage this to scrub out the irrelevant OS items or accept files larger than alpine itself.

      While this might be something to kick back to rocksdb. having some options here would be great.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              adriancole Adrian Cole
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: