[FLINK-35221] Support SQL 2011 reserved keywords as identifiers in Flink HiveParser

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.20.0
• Fix Version/s: hive-3.0.0
• Component/s: Connectors / Hive
• Labels: pull-request-available
• Assignee: Wencong Liu
• Reporter: Wencong Liu
• Created: 24/Apr/24 05:59
• Updated: 24/May/24 01:36
• Resolved: 24/May/24 01:36

Description

According to Hive user documentation[1], starting from version 0.13.0, Hive prohibits the use of reserved keywords as identifiers. Moreover, versions 2.1.0 and earlier allow using SQL11 reserved keywords as identifiers by setting hive.support.sql11.reserved.keywords=false in hive-site.xml. This compatibility feature facilitates jobs that utilize keywords as identifiers.

HiveParser in Flink, relying on Hive version 2.3.9, lacks the option to treat SQL11 reserved keywords as identifiers. This poses a challenge for users migrating SQL from Hive 1.x to Flink SQL, as they might encounter scenarios where keywords are used as identifiers. Addressing this issue is necessary to support such cases.

[1] LanguageManual DDL - Apache Hive - Apache Software Foundation

Issue Links

• links to: GitHub Pull Request #18