[SPARK-43009] Parameterized sql() with constants

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 03/Apr/23 08:54
• Updated: 05/Apr/23 00:12
• Resolved: 05/Apr/23 00:12

Description

Change Scala/Java/Python APIs to accept any language objects from which would be possible to construct literal columns.

The current implementation the parameterized sql() requires arguments as string values parsed to SQL literal expressions that causes the following issues:

• SQL comments are skipped while parsing, so, some fragments of input might be skipped. For example, 'Europe – Amsterdam'. In this case, – Amsterdam is excluded from the input.
• Special chars in string values must be escaped, for instance 'E\'Twaun Moore'