[SPARK-8885] libgplcompression.so already loaded in another classloader

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.2, 1.5.0
• Component/s: SQL

Environment

CentOS 6.2
JDK 1.7.0_51
Spark version: 1.4.0
Hadoop version: 2.2.0
hadoop native lib 32bit

• Target Version/s: 1.4.2, 1.5.0
• Assignee: Unassigned
• Reporter: cen yuhai
• Created: 08/Jul/15 01:42
• Updated: 08/Jul/15 09:52
• Resolved: 08/Jul/15 09:52

Description

Hi, all
I found an Exception when using spark-sql
java.lang.UnsatisfiedLinkError: Native Library /data/lib/native/libgplcompression.so already loaded in another classloader ...

I set spark.sql.hive.metastore.jars=..... in file spark-defaults.conf

It does not happen every time. Who knows why?