[SPARK-6146] Support more datatype in SqlParser

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.3.1, 1.4.0
• Component/s: SQL
• Target Version/s: 1.3.1
• Assignee: Yin Huai
• Reporter: Yin Huai
• Created: 03/Mar/15 23:32
• Updated: 24/Apr/15 00:39
• Resolved: 21/Mar/15 20:28

Description

Right now, I cannot do

df.selectExpr("cast(a as bigint)")

because only the following data types are supported in SqlParser

protected lazy val dataType: Parser[DataType] =
    ( STRING ^^^ StringType
    | TIMESTAMP ^^^ TimestampType
    | DOUBLE ^^^ DoubleType
    | fixedDecimalType
    | DECIMAL ^^^ DecimalType.Unlimited
    | DATE ^^^ DateType
    | INT ^^^ IntegerType
    )

Issue Links

• is related to: SPARK-5911 Make Column.cast(to: String) support fixed precision and scale decimal type
• links to: [Github] Pull Request #5078 (yhuai)