Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-48624 Performance improvement via refactoring some suboptimal algorithms
  3. SPARK-48712

Perf Improvement for Encode with empty string and UTF-8 charset

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0
    • SQL

    Description

       Apple M2 Max
       encode:                                   Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
       ------------------------------------------------------------------------------------------------------------------------
      -UTF-8                                              3672           3697          22          5.4         183.6       1.0X
      +UTF-8                                             79270          79698         448          0.3        3963.5       1.0X

      Attachments

        Activity

          People

            yao Kent Yao
            yao Kent Yao
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: