Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-37436

Uses Python's standard string formatter for SQL API in pandas API on Spark

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.3.0
    • PySpark
    • None

    Description

      Currently pyspark.pandas.sql uses its own hacky parser: https://github.com/apache/spark/blob/master/python/pyspark/pandas/sql_processor.py

      We should ideally switch it to the standard Python formatter https://docs.python.org/3/library/string.html#custom-string-formatting

      Attachments

        Issue Links

          Activity

            People

              gurwls223 Hyukjin Kwon
              gurwls223 Hyukjin Kwon
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: