Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-9457 Sorting improvements
  3. SPARK-9458

Avoid object allocation in prefix generation

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.0
    • SQL
    • None

    Description

      In our existing sort prefix generation code, we use expression's eval method to generate the prefix, which results in object allocation for every prefix.

      We can use the specialized getters available on InternalRow directly to avoid the object allocation.

      Attachments

        Activity

          People

            rxin Reynold Xin
            rxin Reynold Xin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: