[KUDU-3518] node error when impala query

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.17.0
• Fix Version/s: 1.18.0, 1.17.1
• Component/s: tserver
• Environment: centos7.9
• Assignee: Unassigned
• Reporter: Pain Sun
• Created: 10/Oct/23 01:11
• Updated: 17/Apr/24 04:51
• Resolved: 17/Apr/24 04:51

Description

Scan kudu with impala-4.3.0 ,there is a bug when reading a table with an empty string in primary key field.

sql:
select
    count(distinct thirdnick)
from
    member.qyexternaluserdetailinfo_new
where
    (
        mainshopnick = "xxx"
        and ownercorpid in ("xxx", "")
        and shoptype not in ("35", "56")
        and isDelete = 0
        and thirdnick != ""
        and thirdnick is not null
    );
 
error:ERROR: Unable to open scanner for node with id '1' for Kudu table 'impala::member.qyexternaluserdetailinfo_new': Invalid argument: No such column: shopnick
 
If update sql like this:
select
    count(distinct thirdnick)
from
    member.qyexternaluserdetailinfo_new
where
    (
        mainshopnick = "xxx"
        and ownercorpid in ("xxx", "")
        and shopnick not in ('')
        and shoptype not in ("35", "56")
        and isDelete = 0
        and thirdnick != ""
        and thirdnick is not null
    );
no error.
 
this error appears in kudu-1.17.0 ,but kudu-1.16.0 is good.
 
There is 1000000 items in this table ,280000 items where empty string.
table schema like this:

--------------------------------------------------------------------------------------------------------------------+

name

type

comment

primary_key

key_unique

nullable

default_value

encoding

compression

block_size

--------------------------------------------------------------------------------------------------------------------+

mainshopnick	string		true	true	false		AUTO_ENCODING	DEFAULT_COMPRESSION	0
shopnick	string		true	true	false		AUTO_ENCODING	DEFAULT_COMPRESSION	0
ownercorpid	string		true	true	false		AUTO_ENCODING	DEFAULT_COMPRESSION	0
shoptype	string		true	true	false		AUTO_ENCODING	DEFAULT_COMPRESSION	0
clientid	string		true	true	false		AUTO_ENCODING	DEFAULT_COMPRESSION	0
thirdnick	string		true	true	false		AUTO_ENCODING	DEFAULT_COMPRESSION	0
id	bigint		true	true	false		AUTO_ENCODING	DEFAULT_COMPRESSION	0
receivermobile	string		false		true		AUTO_ENCODING	DEFAULT_COMPRESSION	0
thirdrealname	string		false		true		AUTO_ENCODING	DEFAULT_COMPRESSION	0
remark	string		false		true		AUTO_ENCODING	DEFAULT_COMPRESSION	0
createtime	timestamp		false		true		AUTO_ENCODING	DEFAULT_COMPRESSION	0
updatetime	timestamp		false		true		AUTO_ENCODING	DEFAULT_COMPRESSION	0
isdelete	int		false		true	0	AUTO_ENCODING	DEFAULT_COMPRESSION	0
buyernick	string		false		true		AUTO_ENCODING	DEFAULT_COMPRESSION	0

--------------------------------------------------------------------------------------------------------------------+

Issue Links

• is duplicated by: IMPALA-12489 Error when scan kudu-1.17.0