[PHOENIX-5552] Hive against Phoenix gets 'Expecting "RPAREN", got "L"' in Tez mode

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: connectors-6.0.0
• Fix Version/s: connectors-6.0.0
• Assignee: Toshihiro Suzuki
• Reporter: Toshihiro Suzuki
• Created: 29/Oct/19 17:43
• Updated: 26/Nov/19 01:28
• Resolved: 14/Nov/19 04:36

Description

Steps to reproduce are as follows;

1. Create a table that has a BIGINT column in Phoenix:

CREATE TABLE TBL (
 COL1 VARCHAR PRIMARY KEY,
 COL2 BIGINT
);

2. Create an external table in Hive against the table created step 1:

create external table tbl (
 col1 string,
 col2 bigint
)
STORED BY 'org.apache.phoenix.hive.PhoenixStorageHandler'
TBLPROPERTIES (
 "phoenix.table.name" = "TBL",
 "phoenix.zookeeper.quorum" = ...,
 "phoenix.zookeeper.znode.parent" = ...,
 "phoenix.zookeeper.client.port" = "2181",
 "phoenix.rowkeys" = "COL1",
 "phoenix.column.mapping" = "col1:COL1,col2:COL2"
);

3. Issue a query for the hive table with a condition of the BIGINT column in Tez mode, but the following error happens:

> select * from tbl where col2 = 100;
Error: java.io.IOException: java.lang.RuntimeException: org.apache.phoenix.exception.PhoenixParserException: ERROR 603 (42P00): Syntax error. Unexpected input. Expecting "RPAREN", got "L" at line 1, column 67. (state=,code=0)

In this case, the problem is that Hive passes whereClause "col2=100L" (as a bigint value with 'L') to Phoenix, but phoenix can't accept the bigint value with 'L', so the syntax error happens.

We need to remove 'L' for bigint values when building phoenix queries.

It looks like this issue happens only in Tez mode.

Issue Links

• links to: GitHub Pull Request #7