Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5691

Preventing duplicate registering of an application has incorrect logic

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.1.1, 1.2.0
    • 1.0.3, 1.1.2, 1.2.2, 1.3.0
    • Deploy
    • None

    Description

      If an application registers twice with the Master, the Master accepts both copies and they both show up in the UI and consume resources. This is incorrect behavior.

      This happens inadvertently in regular usage when the Master is under high load, but it boils down to: when an application times out registering with the master and sends a second registration message, but the Master is still alive, it processes the first registration message for the application but also erroneously processes the second registration message instead of discarding it.

      Attachments

        Activity

          People

            mccheah Matthew Cheah
            mcheah Matt Cheah
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: