Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Duplicate
-
1.6.2, 2.0.1
-
None
-
None
Description
We can improve the PartitionedAppendOnlyMap implementation by taking advantage of of comparator wrapping, we have observed a 3% performance increase with both IBM's SDK for Java and OpenJDK on PageRank due to the inlining benefit
HiBench large used, pull request to follow
Attachments
Issue Links
- duplicates
-
SPARK-18224 Optimise PartitionedPairBuffer implementation
- Resolved
- links to