[SPARK-20000] Spark Hive tests aborted due to lz4-java on ppc64le

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 2.2.0
• Component/s: Tests
• Labels: ppc64le

Environment

Ubuntu 14.04 ppc64le
$ java -version
openjdk version "1.8.0_111"
OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14)
OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode)

• Assignee: Unassigned
• Reporter: Sonia Garudi
• Created: 17/Mar/17 09:29
• Updated: 30/Oct/17 07:06
• Resolved: 30/Oct/17 07:06

Description

The tests are getting aborted in Spark Hive project with the following error :

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00003fff94dbf114, pid=6160, tid=0x00003fff6efef1a0
#
# JRE version: OpenJDK Runtime Environment (8.0_111-b14) (build 1.8.0_111-8u111-b14-3~14.04.1-b14)
# Java VM: OpenJDK 64-Bit Server VM (25.111-b14 mixed mode linux-ppc64 compressed oops)
# Problematic frame:
# V  [libjvm.so+0x56f114]

In the thread log file, I found the following traces :
Event: 3669.042 Thread 0x00003fff89976800 Exception <a 'java/lang/NoClassDefFoundError': Could not initialize class net.jpountz.lz4.LZ4JNI> (0x000000079fcda3b8) thrown at [/build/openjdk-8-fVIxxI/openjdk-8-8u111-b14/src/hotspot/src/share/vm/oops/instanceKlass.cpp, line 890]

This error is due to the lz4-java (version 1.3.0), which doesn’t have support for ppc64le.PFA the thread log file.

Issue Links

• duplicates: SPARK-21276 Update lz4-java to remove custom LZ4BlockInputStream