Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18224

Optimise PartitionedPairBuffer implementation

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 1.6.2, 2.0.1
    • Fix Version/s: None
    • Component/s: Spark Core
    • Labels:
      None

      Description

      Like the PartitionedAppendOnlyMap improvement we can make (SPARK-18223), this change takes advantage of comparator wrapping, we have observed a 3% performance increase with IBM's SDK for Java and OpenJDK on PageRank due to the inlining benefit

      HiBench large used, pull request to follow

        Issue Links

          Activity

          Hide
          apachespark Apache Spark added a comment -

          User 'a-roberts' has created a pull request for this issue:
          https://github.com/apache/spark/pull/15736

          Show
          apachespark Apache Spark added a comment - User 'a-roberts' has created a pull request for this issue: https://github.com/apache/spark/pull/15736

            People

            • Assignee:
              Unassigned
              Reporter:
              aroberts Adam Roberts
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development