[SPARK-31886] Fix the wrong coloring of nodes in DAG-viz

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.0, 3.1.0
• Component/s: Web UI
• Assignee: Kousuke Saruta
• Reporter: Kousuke Saruta
• Created: 01/Jun/20 11:07
• Updated: 03/Jun/20 08:17
• Resolved: 03/Jun/20 08:17

Description

In the Job Page and Stage Page, nodes which are associated with "barrier mode" in the DAG-viz will be colored pale green.

But, with some type of jobs, nodes which are not associated with the mode will also colored.

You can reproduce with the following operation.

sc.parallelize(1 to 10).barrier.mapPartitions(identity).repartition(1).collect() 

Issue Links

• links to: [Github] Pull Request #28694 (sarutak)
• links to: [Github] Pull Request #28694 (sarutak)