[SPARK-22598] ExecutorAllocationManager does not requests new executors when executor fail and target has not change

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 2.2.0
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Lijia Liu
• Created: 24/Nov/17 07:23
• Updated: 13/Dec/17 13:50
• Resolved: 29/Nov/17 11:11

Description

ExecutorAllocationManager call ExecutorAllocationClient.requestTotalExecutors to request new executors when target has not changed.
But, when executor fail and target has not changed, the spark job will hang and no new executors will be requested.

Issue Links

• duplicates: SPARK-21834 Incorrect executor request in case of dynamic allocation
• links to: [Github] Pull Request #19812 (liutang123)