Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18975

Add an API to remove SparkListener from SparkContext

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.2.0
    • Component/s: Spark Core
    • Labels:
      None

      Description

      In current Spark we could add customized SparkListener through SparkContext#addListener API, but there's no API to remove the registered one. In our scenario SparkListener will be added repeatedly accordingly to the changed environment. If lacks the ability to remove listeners, there might be bunch of registered listeners finally, this is unnecessary and potentially affect the performance. So here propose to add an API to remove registered listener.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jerryshao Saisai Shao
                Reporter:
                jerryshao Saisai Shao
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: