[HUDI-2849] Improve job/stage description in spark UI for hudi write

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.10.1
• Component/s: deltastreamer, spark
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Yuwei Xiao
• Created: 24/Nov/21 08:56
• Updated: 26/Jan/22 13:34
• Resolved: 26/Jan/22 13:34

Description

The following image shows upsert process using deltastreamer. The job description is unclear and sometimes misleading. E.g., there are two jobs with name 'isEmpty' and one of them actually can be removed. The job 8 does the partition and write task, but it is named as 'Getting small files from partitions'.

Issue Links

• links to: GitHub Pull Request #4222