[SPARK-36282] Spark ThriftServer does not search hive external table which storage in hbase

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 3.0.1
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Yu Wang
• Created: 26/Jul/21 01:34
• Updated: 26/Jul/21 05:19
• Resolved: 26/Jul/21 05:19

Description

hive version is 2.3.3, hbase version is 2.4.2;

CREATE EXTERNAL TABLE `temp.mapping_from_hbase`(
`tuid` string COMMENT '',
`index` int COMMENT '')
ROW FORMAT SERDE
'org.apache.hadoop.hive.hbase.HBaseSerDe'
STORED BY
'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (
'hbase.columns.mapping'=':key,info:index',
'serialization.format'='1')
TBLPROPERTIES (
'hbase.mapred.output.outputtable'='x:tuid_to_index',
'hbase.table.name'='x:tuid_to_index',
'transient_lastDdlTime'='1626835726')

When I use spark version 2.4.3 to search temp.mapping_from_hbase which can find it, but use spark version 3.0.1 can not do it.

Issue Links

• duplicates: SPARK-34210 Cannot create a record reader because of a previous error when spark accesses the hive on HBase table