[SPARK-42979] Define literal constructors as keywords

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 30/Mar/23 13:23
• Updated: 30/Mar/23 14:44
• Resolved: 30/Mar/23 14:44

Description

Currently, Spark SQL defines literal constructors as:

 

| identifier stringLit #typeConstructor

where identifier is parsed later by visitTypeConstructor():

    valueType match {
      case "DATE" =>
        val zoneId = getZoneId(conf.sessionLocalTimeZone)
        val specialDate = convertSpecialDate(value, zoneId).map(Literal(_, DateType))
        specialDate.getOrElse(toLiteral(stringToDate, DateType))
      case "TIMESTAMP_NTZ" =>
...

So, the literal constructors are not Spark SQL keywords, and this causes some inconveniences while analysing/transforming the lexer tree. For example, while forming the stable column aliases.

Need to define literal constructors in SqlBaseParser.g4.

 

 

Issue Links

• is a clone of: SPARK-42873 Define Spark SQL types as keywords