Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
2.3.2
-
None
Description
Test step to reproduce:
1) bin/spark-shell --master yarn --conf spark.executor.instances=3
2){{sc.parallelize(1 to 10000, 10).map
{ x => throw new RuntimeException("Bad executor")}.collect() }}
3) Open Application from the history server UI
Jobs table and Aggregated metrics are showing lesser number of tasks.