[HIVE-12160] Hbase table query execution fails in secured cluster when hive.exec.mode.local.auto is set to true

• Type: Bug
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.1.0, 2.0.0
• Component/s: Security
• Assignee: Aihua Xu
• Reporter: Aihua Xu
• Created: 13/Oct/15 15:04
• Updated: 28/May/19 13:29

Description

In a secured cluster with kerberos, a simple query like select count from hbase_table; will fail with the following exception when hive.exec.mode.local.auto is set to true.

Error: Error while processing statement: FAILED: Execution Error, return code 134 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask (state=08S01,code=134)

There is another scenario which may be caused by the same reason.

Set hive.auto.convert.join to true, the join query select * from hbase_t1 join hbase_t2 on hbase_t1.id = hbase_t2.id; also fails with the following exception:

Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask (state=08S01,code=2)

The failure seems to be caused by: during the compiliation, the main process doesn't need to access HBase, so HBase token is acquired, thus whem the process passes the tokens to child process, HBase token is not included. In MapredLocalTask, since the separate child process doesn't have HBase token so it fails.

Issue Links

• relates to: HIVE-21748 HBase Operations Can Fail When Using MAPREDLOCAL
• relates to: HIVE-13017 Child process of HiveServer2 fails to get delegation token from non default FileSystem