[SPARK-20078] Mesos executor configurability for task name and labels

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.2.0
• Component/s: Mesos
• Assignee: Kalvin Chau
• Reporter: Kalvin Chau
• Created: 23/Mar/17 23:21
• Updated: 25/Mar/17 10:43
• Resolved: 25/Mar/17 10:42

Description

Add in the ability to configure the mesos task name as well as add labels to the Mesos ExecutorInfo protobuf message.

Currently all executors that are spun up are named Task X (where X is the executor number).

For centralized logging it would be nice to be able to have SparkJob1 X then Name, as well as allowing users to add any labels they would want.

In this PR I chose "k1:v1,k2:v2" as the format, colons separating key-value and commas to list out more than one.

Issue Links

• links to: [Github] Pull Request #17404 (kalvinnchau)