[SPARK-27169] number of active tasks is negative on executors page

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 2.3.2
• Component/s: Web UI
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: acupple
• Created: 15/Mar/19 02:21
• Updated: 25/May/21 01:53
• Resolved: 25/May/21 01:40

Description

I use spark to process some data in HDFS and HBASE, I use one thread consume message from a queue, and then submit to a thread pool（16 fix size）for spark processor.

But when run for some time, the active jobs will be thousands, and number of active tasks are negative.

Actually, these jobs are already done when I check driver logs。