[SPARK-20333] Fix HashPartitioner in DAGSchedulerSuite

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.3.0
• Component/s: Spark Core
• Assignee: Jin Xing
• Reporter: Jin Xing
• Created: 14/Apr/17 03:55
• Updated: 30/May/17 19:03
• Resolved: 30/May/17 19:03

Description

In test
"don't submit stage until its dependencies map outputs are registered (SPARK-5259)"
"run trivial shuffle with out-of-band executor failure and retry"
"reduce tasks should be placed locally with map output"
HashPartitioner should be compatible with num of child RDD's partitions.

Issue Links

• links to: [Github] Pull Request #17634 (jinxing64)