[SPARK-19999] Test failures in Spark Core due to java.nio.Bits.unaligned()

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.1.1, 2.2.0
• Component/s: Spark Core
• Labels: ppc64le

Environment

Ubuntu 14.04 ppc64le
$ java -version
openjdk version "1.8.0_111"
OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14)
OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode)

• External issue URL: https://bugs.openjdk.java.net/browse/JDK-8165231
• Assignee: Sonia Garudi
• Reporter: Sonia Garudi
• Created: 17/Mar/17 09:27
• Updated: 02/Apr/17 14:34
• Resolved: 30/Mar/17 15:08

Description

There are multiple test failures seen in Spark Core project with the following error message :

java.lang.IllegalArgumentException: requirement failed: No support for unaligned Unsafe. Set spark.memory.offHeap.enabled to false.

These errors occur due to java.nio.Bits.unaligned(), which does not return true for the ppc64le arch.

Issue Links

• links to: [Github] Pull Request #17472 (samelamin)
• links to: [Github] Pull Request #17509 (kiszk)