Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3875

Add "reconnect" API to TezClient for HSI HA

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      For HiveServer2 HA use cases with LLAP, launching a new Tez session (AM) after failover adds non-interactive latency. Additionally, Tez with LLAP does significant work to provision a long-lived session and hold on to necessary resources allocated to it. We don't want to redo that work after failover and potentially be unable to schedule equivalent resources that may be taken by other applications during failover.

      HS2 uses TezClient for creating sessions. To simplify HS2 failover to an existing Tez AM, add a "reconnect" method to TezClient.

      public void reconnect(ApplicationId) { ... }
      

      reconnect will setup the TezClient context very similar to start except it parameterizes the sessionAppId and doesn't launch a new AM.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ewohlstadter Eric Wohlstadter
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: