Details
Description
The hashmap stageIdToActiveJobIds in JobProgressListener is never cleared. So the hashmap keep increasing in size indefinitely. This is a blocker for 24/7 running applications like Spark Streaming apps.
Attachments
Issue Links
- links to
User 'tdas' has created a pull request for this issue:
https://github.com/apache/spark/pull/4741