Description
Currently pyspark.pandas.sql uses its own hacky parser: https://github.com/apache/spark/blob/master/python/pyspark/pandas/sql_processor.py
We should ideally switch it to the standard Python formatter https://docs.python.org/3/library/string.html#custom-string-formatting
Attachments
Issue Links
- is related to
-
SPARK-37516 Uses Python's standard string formatter for SQL API in PySpark
-
- Resolved
-
- links to