[HIVE-3431] Avoid race conditions while downloading resources from non-local filesystem

• Type: Improvement
• Status: Closed
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 0.10.0
• Fix Version/s: 0.11.0
• Component/s: Configuration
• Assignee: Navis Ryu
• Reporter: Navis Ryu
• Created: 05/Sep/12 11:57
• Updated: 16/May/13 21:10
• Resolved: 07/Jan/13 17:39

Description

"add resource <remote-uri>" command downloads the resource file to location specified by conf "hive.downloaded.resources.dir" in local file system. But when the command above is executed concurrently to hive-server for same file, some client fails by VM crash, which is caused by overwritten file by other requests.

So there should be a configuration to provide per request location for add resource command, something like "set hiveconf:hive.downloaded.resources.dir=temporary"

Issue Links

• relates to: HIVE-3697 External JAR files on HDFS can lead to race condition with hive.downloaded.resources.dir