[HIVE-7984] AccumuloOutputFormat Configuration items from StorageHandler not re-set in Configuration in Tez

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Component/s: StorageHandler, Tez
• Assignee: Josh Elser
• Reporter: Josh Elser
• Created: 04/Sep/14 15:54
• Updated: 13/Nov/14 19:43
• Resolved: 19/Sep/14 07:10

Description

Ran AccumuloStorageHandler queries with Tez and found that configuration elements that are pulled from the -hiveconf and passed to the inputJobProperties or outputJobProperties by the AccumuloStorageHandler aren't available inside of the Tez container.

I'm guessing that there is a disconnect from the configuration that the StorageHandler creates and what the Tez container sees.

The HBaseStorageHandler likely doesn't run into this because it expects to have hbase-site.xml available via tmpjars (and can extrapolate connection information from that file). Accumulo's site configuration file is not meant to be shared with consumers which means that this exact approach is not sufficient.