Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-10143

HS2 fails to clean up Spark client state on timeout [Spark Branch]

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • spark-branch
    • 1.2.0
    • Spark
    • None

    Description

      When a new client is registered with the Spark client and fails to connect back in time, the code will time out the future and HS2 will give up on that client. But the RSC backend does not clean up all the state, and the client is still allowed to connect back. That can lead to the client staying alive indefinitely and holding on to cluster resources, since HS2 doesn't know it's alive but the connection still exists.

      Attachments

        1. HIVE-10143.1-spark.patch
          4 kB
          Marcelo Masiero Vanzin

        Issue Links

          Activity

            People

              vanzin Marcelo Masiero Vanzin
              vanzin Marcelo Masiero Vanzin
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: