[KAFKA-4988] JVM crash when running on Alpine Linux

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 0.10.2.0
• Component/s: streams
• Assignee: Unassigned
• Reporter: Vincent Rischmann
• Created: 30/Mar/17 21:52
• Updated: 31/Aug/18 18:10
• Resolved: 31/Aug/18 18:10

Description

I'm developing my Kafka Streams application using Docker and I run my jars using the official openjdk:8-jre-alpine image.

I'm just starting to use windowing and now the JVM crashes because of an issue with RocksDB I think.

It's trivial to fix on my part, just use the debian jessie based image. However, it would be cool if alpine was supported too since its docker images are quite a bit less heavy

Exception in thread "StreamThread-1" java.lang.UnsatisfiedLinkError: /tmp/librocksdbjni3285995384052305662.so: Error loading shared library ld-linux-x86-64.so.2: No such file or directory (needed by /tmp/librocksdbjni3285995384052305662.so)
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at org.rocksdb.NativeLibraryLoader.loadLibraryFromJar(NativeLibraryLoader.java:78)
at org.rocksdb.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:56)
at org.rocksdb.RocksDB.loadLibrary(RocksDB.java:64)
at org.rocksdb.RocksDB.<clinit>(RocksDB.java:35)
at org.rocksdb.Options.<clinit>(Options.java:22)
at org.apache.kafka.streams.state.internals.RocksDBStore.openDB(RocksDBStore.java:115)
at org.apache.kafka.streams.state.internals.RocksDBStore.init(RocksDBStore.java:148)
at org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.init(ChangeLoggingKeyValueBytesStore.java:39)
at org.apache.kafka.streams.state.internals.MeteredKeyValueStore$7.run(MeteredKeyValueStore.java:100)
at org.apache.kafka.streams.processor.internals.StreamsMetricsImpl.measureLatencyNs(StreamsMetricsImpl.java:188)
at org.apache.kafka.streams.state.internals.MeteredKeyValueStore.init(MeteredKeyValueStore.java:131)
at org.apache.kafka.streams.state.internals.CachingKeyValueStore.init(CachingKeyValueStore.java:62)
at org.apache.kafka.streams.processor.internals.AbstractTask.initializeStateStores(AbstractTask.java:86)
at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:141)
at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:834)
at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1207)
at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1180)
at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:937)
at org.apache.kafka.streams.processor.internals.StreamThread.access$500(StreamThread.java:69)
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:236)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:255)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:339)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:286)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1030)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:582)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:368)
#

1. A fatal error has been detected by the Java Runtime Environment:
   #
2. SIGSEGV (0xb) at pc=0x00007f60f34ce088, pid=1, tid=0x00007f60f3705ab0
   #
3. JRE version: OpenJDK Runtime Environment (8.0_121-b13) (build 1.8.0_121-b13)
4. Java VM: OpenJDK 64-Bit Server VM (25.121-b13 mixed mode linux-amd64 compressed oops)
5. Derivative: IcedTea 3.3.0
6. Distribution: Custom build (Thu Feb 9 08:34:09 GMT 2017)
7. Problematic frame:
8. C [ld-musl-x86_64.so.1+0x50088] memcpy+0x24
   #
9. Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
   #
10. An error report file with more information is saved as:
11. /usr/local/event-counter/hs_err_pid1.log
    #
12. If you would like to submit a bug report, please include
13. instructions on how to reproduce the bug and visit:
14. http://icedtea.classpath.org/bugzilla
    #

Issue Links

• relates to: KAFKA-6033 Kafka Streams does not work with musl-libc (alpine linux)