Uploaded image for project: 'Spark'
  1. Spark

Shuffle

Summary

Issues: Unresolved

Key Summary Due Date
Improvement SPARK-8447 Test external shuffle service with all shuffle managers
Bug SPARK-22286 OutOfMemoryError caused by memory leak and large serializer batch size in ExternalAppendOnlyMap
Improvement SPARK-1272 Don't fail job if some local directories are buggy

View Issues

Issues: Updated recently

Key Summary Updated
Bug SPARK-20295 when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue
Improvement SPARK-2926 Add MR-style (merge-sort) SortShuffleReader for sort-based shuffle
Bug SPARK-22426 Spark AM launching containers on node where External spark shuffle service failed to initialize

View Issues

Versions: Unreleased

Name Release date
Unreleased 0.8.2  
Unreleased 0.9.3  
Unreleased 1.0.3  
Unreleased 1.1.2  
Unreleased 1.2.3  
Unreleased 1.3.2  
Unreleased 1.4.2  
Unreleased 1.5.3  
Unreleased 1.6.4  
Unreleased 2.0.3  
Unreleased 2.1.3  
Unreleased 2.2.1  
Unreleased 2.3.0  
Unreleased 3.0.0  
Unreleased 2.2.2  

...and 10 more

Show first 5 only