[HIVE-24706] Spark SQL access hive on HBase table access exception

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: HBase Handler
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: zhangzhanchang
• Created: 30/Jan/21 07:40
• Updated: 23/Jan/24 00:20

Description

Hivehbasetableinputformat relies on two versions of inputformat，one is org.apache.hadoop.mapred.InputFormat, the other is org.apache.hadoop.mapreduce.InputFormat,Causes

spark 3.0(https://github.com/apache/spark/pull/31302) both conditions to be true:

1. classOf[oldInputClass[_, _]].isAssignableFrom(inputFormatClazz) is true
2. classOf[newInputClass[_, _]].isAssignableFrom(inputFormatClazz) is true

Hivehbasetableinputformat relies on inputformat to be changed to org.apache.hadoop.mapreduce or org.apache.hadoop.mapred?

 

Issue Links

• links to: GitHub Pull Request #4063
• links to: GitHub Pull Request #4199