Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3875

Add "reconnect" API to TezClient for HSI HA

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 0.9.next
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      For HiveServer2 HA use cases with LLAP, launching a new Tez session (AM) after failover adds non-interactive latency. Additionally, Tez with LLAP does significant work to provision a long-lived session and hold on to necessary resources allocated to it. We don't want to redo that work after failover and potentially be unable to schedule equivalent resources that may be taken by other applications during failover.

      HS2 uses TezClient for creating sessions. To simplify HS2 failover to an existing Tez AM, add a "reconnect" method to TezClient.

      public void reconnect(ApplicationId) { ... }
      

      reconnect will setup the TezClient context very similar to start except it parameterizes the sessionAppId and doesn't launch a new AM.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ewohlstadter Eric Wohlstadter
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: