[SPARK-1828] Created forked version of hive-exec that doesn't bundle other dependencies

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.0.0
• Component/s: SQL
• Assignee: Patrick Wendell
• Reporter: Patrick Wendell
• Created: 14/May/14 07:52
• Updated: 15/Aug/14 17:20
• Resolved: 14/May/14 16:51

Description

The hive-exec jar includes a bunch of Hive's dependencies in addition to hive itself (protobuf, guava, etc). See HIVE-5733. This breaks any attempt in Spark to manage those dependencies.

The only solution to this problem is to publish our own version of hive-exec 0.12.0 that behaves correctly. While we are doing this, we might as well re-write the protobuf dependency to use the shaded version of protobuf 2.4.1 that we already have for Akka.

Issue Links

• duplicates: SPARK-1802 Audit dependency graph when Spark is built with -Phive
• duplicates: HIVE-5733 Publish hive-exec artifact without all the dependencies