Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-48624 Performance improvement via refactoring some suboptimal algorithms
  3. SPARK-48686

Improve performance of ParserUtils.unescapeSQLString

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0
    • SQL

    Description

      The `ParserUtils.unescapeSQLString` method is currently implemented using regexes for part of the parsing, but is costly because multiple Matcher instances are created for every input cahracter.

      I think that we should optimize this to remove the use of regexes.

      I will submit a PR for this.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-34263 Simplify the code for treating unicode/octal/escaped characters in string literals

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #47062

          Activity

            People

              joshrosen Josh Rosen
              joshrosen Josh Rosen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: