Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: Spark
    • Labels:
      None
    • Target Version/s:

      Description

      HoS users have two session ids, one id for the Hive session and another id for the Spark session, both are UUIDs.

      I think some improvements could be made here:

      The Spark session id could just be a counter that is incremented for each new Spark session within a Hive session. Each Spark session is still globally identifiable by its associated Hive session id + its own counter. This may make more sense since the Hive session - Spark session has a 1-to-many relationship, as in a single Hive session can contain multiple Spark sessions, and each Spark session must belong to a Hive session.

      Furthermore, we should include both the Hive session id and Spark session id in the console logs + the Spark Web UI.

        Attachments

        1. HIVE-19008.2.patch
          10 kB
          Sahil Takiar
        2. HIVE-19008.1.patch
          9 kB
          Sahil Takiar

          Activity

            People

            • Assignee:
              stakiar Sahil Takiar
              Reporter:
              stakiar Sahil Takiar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: