[IMPALA-7778] RCFile parser ignores escape characters

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: Impala 2.0, Impala 2.1, Impala 2.2, Impala 2.3.0, Impala 2.5.0, Impala 2.4.0, Impala 2.6.0, Impala 2.7.0, Impala 2.8.0, Impala 2.9.0, Impala 2.10.0, Impala 2.11.0, Impala 3.0, Impala 3.1.0
• Component/s: Backend
• Labels: correctness
• Target Version: Product Backlog
• Epic Color: ghx-label-2
• Assignee: Unassigned
• Reporter: Tim Armstrong
• Created: 29/Oct/18 16:39
• Updated: 07/Jan/19 18:15

Description

If an RCFile table has an escape character specified then it is ignored by Impala.

-- HIVE
CREATE TABLE rc_escape ( s string)
ROW FORMAT delimited fields terminated by ','  escaped by '\\'
STORED AS RCFILE;
insert into rc_escape select '\\"';
select length(s), s from rc_escape;
-- +-----+-----+
-- | c0  |  s  |
-- +-----+-----+
-- | 2   | \"  |
-- +-----+-----+

-- IMPALA
invalidate metadata rc_escape;
select length(s), s from rc_escape;
-- +-----------+-----+
-- | length(s) | s   |
-- +-----------+-----+
-- | 3         | \\" |
-- +-----------+-----+

I reproduced on my dev env with "beeline -n $USER -u jdbc:hive2://localhost:11050/default" for Hive and "impala-shell" for Impala.