[SPARK-5402] Log executor ID at executor-construction time

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.2.1, 1.3.0
• Component/s: Spark Core
• Target Version/s: 1.2.1, 1.3.0
• Assignee: Ryan Williams
• Reporter: Ryan Williams
• Created: 25/Jan/15 07:09
• Updated: 25/Jan/15 22:21
• Resolved: 25/Jan/15 22:21

Description

One stumbling block I've hit while debugging Spark-on-YARN jobs is that yarn logs presents each executor's stderr/stdout by container name, but I often need to find the logs for a specific executor ID; the executor ID isn't printed anywhere convenient in each executor's logs, afaict.

I added a simple logInfo to Executor.scala locally and it's been useful, so I'd like to merge it upstream.

PR forthcoming.

Issue Links

• links to: [Github] Pull Request #4195 (ryan-williams)