[OOZIE-3639] Build failure on Linux ARM64

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 5.2.1
• Fix Version/s: 5.3.0
• Component/s: build
• Labels: patch-available
• Assignee: Martin Tzvetanov Grigorov
• Reporter: Martin Tzvetanov Grigorov
• Created: 07/Oct/21 06:58
• Updated: 04/Nov/21 10:02
• Resolved: 04/Nov/21 09:57

Description

Trying to build Apache Oozie on Linux ARM64 fails due:

1. An old version of snappy-java library (transitive dependency of Apache Spark):

[ERROR] testMain(org.apache.oozie.action.hadoop.TestSparkMain)  Time elapsed: 3.512 s  <<< ERROR!
java.lang.IllegalArgumentException: org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] no native library is found for os.name=Linux and os.arch=aarch64
	at org.apache.spark.io.SnappyCompressionCodec$.liftedTree1$1(CompressionCodec.scala:171)
	at org.apache.spark.io.SnappyCompressionCodec$.org$apache$spark$io$SnappyCompressionCodec$$version$lzycompute(CompressionCodec.scala:168)
	at org.apache.spark.io.SnappyCompressionCodec$.org$apache$spark$io$SnappyCompressionCodec$$version(CompressionCodec.scala:168)
	at org.apache.spark.io.SnappyCompressionCodec.<init>(CompressionCodec.scala:152)
...
 Caused by: org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] no native library is found for os.name=Linux and os.arch=aarch64
	at org.xerial.snappy.SnappyLoader.findNativeLibrary(SnappyLoader.java:331)
	at org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:171)
	at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:152)
	at org.xerial.snappy.Snappy.<clinit>(Snappy.java:46)
	at org.apache.spark.io.SnappyCompressionCodec$.liftedTree1$1(CompressionCodec.scala:169)
	... 80 more

Adding a dependency management for snappy-java to use org.xerial.snappy:snappy-java:1.1.8.4 fixes it!

2. Test failure in TestPyspark:

[ERROR] testPyspark(org.apache.oozie.action.hadoop.TestPyspark)  Time elapsed: 59.513 s  <<< FAILURE!
junit.framework.ComparisonFailure: expected:<[SUCCEED]ED> but was:<[FAILED/KILL]ED>
	at junit.framework.Assert.assertEquals(Assert.java:100)
	at junit.framework.Assert.assertEquals(Assert.java:107)
	at junit.framework.TestCase.assertEquals(TestCase.java:260)
	at org.apache.oozie.action.hadoop.TestPyspark.testPysparkHelper(TestPyspark.java:107)
	at org.apache.oozie.action.hadoop.TestPyspark.testPyspark(TestPyspark.java:85)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   ... 

Issue Links

• links to: Pull Request for snappy-java