[SPARK-6668] repeated asking to remove non-existent executor

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.0
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Davies Liu
• Created: 02/Apr/15 04:39
• Updated: 16/Apr/15 23:42
• Resolved: 16/Apr/15 23:42

Description

15/04/01 21:37:15 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
15/04/01 21:37:17 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:17 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 0
15/04/01 21:37:18 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 1
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
[Stage 0:>                                                          (0 + 0) / 2]15/04/01 21:37:18 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 2
.....
15/04/01 21:37:44 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 244
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:44 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 245
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:44 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 246
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 247
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 248
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 249
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 250
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 251
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 252
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 253
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 254
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 255
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:45 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 256
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:46 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 257
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.
15/04/01 21:37:46 ERROR SparkDeploySchedulerBackend: Asked to remove non-existent executor 258
NOTE: SPARK_PREPEND_CLASSES is set, placing locally compiled Spark classes ahead of assembly.

Issue Links

• is duplicated by: SPARK-6890 Local cluster mode is broken with SPARK_PREPEND_CLASSES