[HIVE-14167] Use work directories provided by Tez instead of directly using YARN local dirs

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.1.1, 2.2.0
• Target Version/s: 2.2.0
• Assignee: Wei Zheng
• Reporter: Siddharth Seth
• Created: 06/Jul/16 05:37
• Updated: 08/Dec/16 14:26
• Resolved: 25/Jul/16 07:36

Description

HIVE-13303 fixed things to use multiple directories instead of a single tmp directory. However it's using yarn-local-dirs directly.
I'm not sure how well using the yarn-local-dir will work on a secure cluster.

Would be better to use Tez*Context.getWorkDirs. This provides an app specific directory - writable by the user.

cc sershe

Issue Links

• relates to: HIVE-13303 spill to YARN directories, not tmp, when available