Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-37436

Uses Python's standard string formatter for SQL API in pandas API on Spark

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete CommentsDelete
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.3.0
    • 3.3.0
    • PySpark
    • None

    Description

      Currently pyspark.pandas.sql uses its own hacky parser: https://github.com/apache/spark/blob/master/python/pyspark/pandas/sql_processor.py

      We should ideally switch it to the standard Python formatter https://docs.python.org/3/library/string.html#custom-string-formatting

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gurwls223 Hyukjin Kwon Assign to me
            gurwls223 Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment