[IMPALA-2893] Impala receives truncated query when pasting a large amount of text into impala-shell

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: Impala 2.0, Impala 2.2, impala 2.3
• Component/s: Clients
• Labels: impala-shell usability
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Xiaomin Zhang
• Created: 27/Jan/16 02:45
• Updated: 09/Aug/16 19:54

Description

With attached case_full.sql, I got AnalysisException during parsing when pasting the whole content into impala-shell such as:

ERROR: AnalysisException: Syntax error in line 25:
left outer join (select skpk...
^
Encountered: LEFT
Expected: AND, AS, BETWEEN, DIV, IN, IS, LIKE, NOT, OR, REGEXP, RLIKE, COMMA, IDENTIFIER

CAUSED BY: Exception: Syntax error

The query is correct and can be executed in Hive when pasting into Hive CLI. The error point is not fixed, randomly happening when the query is larger enough.

Some steps already done to identify this cause:
1. Pasting to a query_file and execution is ok with -f query_file
2. execution is ok when disabling readline support in impala-shell.py
3. This issue seems caused by a readline bug which is still not resolved:
https://lists.gnu.org/archive/html/bug-readline/2013-07/msg00019.html

As an improvement, is it possible to provide an option to disable usage of readline in impala-shell.py, so that pasting large amount of text is ok?