[SPARK-26999] SparkSQL CLIDriver parses sql statement incorrectly

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.3.2, 2.3.3, 2.4.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Fei Wang
• Created: 27/Feb/19 02:00
• Updated: 27/Feb/19 09:01
• Resolved: 27/Feb/19 09:01

Description

SparkSQLCLIDriver parse sql statement incorrectly, because its processLine method is not correct.
The processLine method is one method of CLIDriver, which is a class of hive-cli.
SparkSQLCLIDriver extends CLIDriver, but it does't override processLine method.
The spark-hive-cliet version of master branch is hive-1.2.1.spark2.
In hive-1.2.1, the processLine method splits statement directly by ";", however, there may be a quote.
For example:
The statement:

select * from table_a where column_a not like '%;';

Will be parsed to:

select * from table_a where column_a not like '%

 

 

Issue Links

• links to: GitHub Pull Request #23902