[BEAM-1829] MQTT message compression not working on Rapsberry Pi

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Affects Version/s: 0.6.0
• Fix Version/s: 2.0.0
• Component/s: io-java-mqtt
• Labels: MQTT Snappy
• External issue URL: https://github.com/xerial/snappy-java/issues/147
• Assignee: Jean-Baptiste Onofré
• Reporter: Vassil Kolarov
• Created: 29/Mar/17 14:55
• Updated: 16/May/20 13:57
• Resolved: 19/Apr/17 11:22

Description

Most probably due to this bug: https://github.com/xerial/snappy-java/issues/147, the following exception is raised, when running on Raspberry Pi:
Exception in thread "main" java.lang.UnsatisfiedLinkError: /root/_{/tmp/snappy-1.1.2-3c6134d1-26c5-4fb0-b6c9-669d4848d15b-libsnappyjava.so: /root/}/tmp/snappy-1.1.2-3c6134d1-26c5-4fb0-b6c9-669d4848d15b-libsn
appyjava.so: cannot open shared object file: No such file or directory
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1929)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1814)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1083)
at org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:174)
at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:152)
at org.xerial.snappy.Snappy.<clinit>(Snappy.java:46)
at org.xerial.snappy.SnappyOutputStream.<init>(SnappyOutputStream.java:97)
at org.xerial.snappy.SnappyOutputStream.<init>(SnappyOutputStream.java:89)
at org.xerial.snappy.SnappyOutputStream.<init>(SnappyOutputStream.java:79)
at org.apache.beam.sdk.util.SerializableUtils.serializeToByteArray(SerializableUtils.java:48)
at org.apache.beam.sdk.util.SerializableUtils.ensureSerializable(SerializableUtils.java:83)
at org.apache.beam.sdk.io.Read$Unbounded.<init>(Read.java:141)
at org.apache.beam.sdk.io.Read$Unbounded.<init>(Read.java:136)
at org.apache.beam.sdk.io.Read.from(Read.java:56)
at org.apache.beam.sdk.io.mqtt.MqttIO$Read.expand(MqttIO.java:274)
at org.apache.beam.sdk.io.mqtt.MqttIO$Read.expand(MqttIO.java:221)
at org.apache.beam.sdk.runners.PipelineRunner.apply(PipelineRunner.java:76)
at org.apache.beam.runners.direct.DirectRunner.apply(DirectRunner.java:296)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:388)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:302)
at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:47)
at org.apache.beam.sdk.Pipeline.apply(Pipeline.java:152)
at org.blah.beam.MqttPipeline.main(MqttPipeline.java:37)

Increasing the snappy version to 1.1.4 will probably fix the issue.

Best regards,
Vassil

Issue Links

• links to: GitHub Pull Request #2572