[HIVE-6825] custom jars for Hive query should be uploaded to scratch dir per query; and/or versioned

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Assignee: Sergey Shelukhin
• Reporter: Sergey Shelukhin
• Created: 03/Apr/14 01:17
• Updated: 09/Apr/14 02:21
• Resolved: 09/Apr/14 02:21

Description

Currently the jars are uploaded to either user directory or global, whatever is configured, which is a mess and can cause collisions. We can upload to scratch directory, and/or version.
There's a tradeoff between having to upload files every time (for example, for commonly used things like HBase input format) (which is what is done now, into global/user path), and having a mess of one-off custom jars and files, versioned, sitting in .hiveJars.

Issue Links

• is blocked by: HIVE-6739 Hive HBase query fails on Tez due to missing jars and then due to NPE in getSplits