[HIVE-11423] Ship hive-storage-api along with hive-exec jar to all Tasks

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Duplicate
• Affects Version/s: 2.0.0
• Component/s: File Formats
• Assignee: Unassigned
• Reporter: Gopal Vijayaraghavan
• Created: 31/Jul/15 04:12
• Updated: 01/Aug/15 01:30
• Resolved: 01/Aug/15 01:30

Description

After moving critical classes into hive-storage-api, those classes are needed for queries to execute successfully.

Currently all queries run fail with ClassNotFound exceptions on a large cluster.

Caused by: java.lang.NoClassDefFoundError: Lorg/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatch;
        at java.lang.Class.getDeclaredFields0(Native Method)
        at java.lang.Class.privateGetDeclaredFields(Class.java:2583)
        at java.lang.Class.getDeclaredFields(Class.java:1916)
        at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.rebuildCachedFields(FieldSerializer.java:150)
        at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.<init>(FieldSerializer.java:109)
        ... 57 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.exec.vector.VectorizedRowBatch
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 62 more

Temporary workaround added to hiverc: add jar ./dist/hive/lib/hive-storage-api-2.0.0-SNAPSHOT.jar;

Issue Links

• is related to: HIVE-11425 submitting a query via CLI against a running cluster fails with ClassNotFoundException: org.apache.hadoop.hive.common.type.HiveDecimal
• relates to: HIVE-11253 Move SearchArgument and VectorizedRowBatch classes to storage-api.