Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-10143

HS2 fails to clean up Spark client state on timeout [Spark Branch]

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: spark-branch
    • Fix Version/s: 1.2.0
    • Component/s: Spark
    • Labels:
      None

      Description

      When a new client is registered with the Spark client and fails to connect back in time, the code will time out the future and HS2 will give up on that client. But the RSC backend does not clean up all the state, and the client is still allowed to connect back. That can lead to the client staying alive indefinitely and holding on to cluster resources, since HS2 doesn't know it's alive but the connection still exists.

        Attachments

        1. HIVE-10143.1-spark.patch
          4 kB
          Marcelo Masiero Vanzin

          Issue Links

            Activity

              People

              • Assignee:
                vanzin Marcelo Masiero Vanzin
                Reporter:
                vanzin Marcelo Masiero Vanzin
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: