[KUDU-2813] Set Spark job descriptions for backup and restore jobs

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.10.0
• Component/s: backup
• Labels: backup
• Assignee: Grant Henke
• Reporter: Grant Henke
• Created: 03/May/19 13:52
• Updated: 05/Jun/19 23:51
• Resolved: 05/Jun/19 23:51

Description

Currently the Spark UI shows "foreachPartition at KuduRestore.scala:87" or something similar for each job stage. Instead we should call something like SparkContext.setJobGroup or SparkContext.setJobDescription to have a more attractive/useful description.

Some ideas for descriptions could be:

• Backup <tableName> (full)
• Restore <tableName> part 1/<n>