Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12308

Better onDisconnected logic for Master

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • Spark Core

    Description

      Pasting vanzin's comment from GitHub(https://github.com/apache/spark/pull/10261#issuecomment-164107825):

      That's because we took opposite approaches. Your PR's approach is "if this connection says the sender address is a listening socket, then also consider that address when sending events about the remote process".

      My PR takes the opposite approach: the address of the remote process is always the address of the socket used to connect, regardless of whether its also listening in another socket.

      I think my approach is in the end more correct, but requires more code to fix existing code. In my view, RpcCallContext.senderAddress should be the address of the socket that sent the message, not the address the remote process is listening on.

      Attachments

        Activity

          People

            Unassigned Unassigned
            zsxwing Shixiong Zhu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: