[HIVE-5133] webhcat jobs that need to access metastore fails in secure mode

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.11.0
• Fix Version/s: 0.13.0
• Component/s: WebHCat
• Hadoop Flags: Reviewed
• Assignee: Eugene Koifman
• Reporter: Thejas Nair
• Created: 21/Aug/13 05:40
• Updated: 22/Sep/14 23:36
• Resolved: 18/Oct/13 22:43

Description

Webhcat job submission requests result in the pig/hive/mr job being run from a map task that it launches. In secure mode, for the pig/hive/mr job that is run to be authorized to perform actions on metastore, it has to have the delegation tokens from the hive metastore.
In case of pig/MR job this is needed if hcatalog is being used in the script/job.

Issue Links

• blocks: HIVE-5511 percentComplete returned by job status from WebHCat is null
• is related to: HIVE-5384 hcatloadstore.pig should be upgraded to org.apache.hive.hcatalog.pig.HCatLoader
• relates to: HIVE-5188 MR job launched through WebHCat fails to find additional jars in classpath
• relates to: HIVE-5353 job submission that requires access to metastore should not require additional jars to be shipped to target node
• relates to: HIVE-5547 webhcat pig job submission should ship hive tar if -usehcatalog is specified

Sub-Tasks

• Document 'usehcatalog' parameter on WebHCat calls: Resolved