[SPARK-20854] extend hint syntax to support any expression, not just identifiers or strings

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.2.0
• Component/s: SQL
• Target Version/s: 2.2.0
• Assignee: Bogdan Raducanu
• Reporter: Bogdan Raducanu
• Created: 23/May/17 10:49
• Updated: 06/Jun/17 11:31
• Resolved: 01/Jun/17 22:55

Description

Currently the SQL hint syntax supports as parameters only identifiers while the Dataset hint syntax supports only strings.

They should support any expression as parameters, for example numbers. This is useful for implementing other hints in the future.

Examples:

df.hint("hint1", Seq(1, 2, 3))
df.hint("hint2", "A", 10000)

sql("select /*+ hint1((1,2,3)) */")
sql("select /*+ hint2('A', 10000) */")

Issue Links

• links to: [Github] Pull Request #18086 (bogdanrdc)
• links to: [Github] Pull Request #18217 (bogdanrdc)