Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21035

Race condition in SparkUtilities#getSparkSession

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0.0
    • Fix Version/s: 4.0.0
    • Component/s: Spark
    • Labels:
      None

      Description

      It can happen, that when in one given session, multiple queries are executed, that due to a race condition, multiple spark application master gets kicked off.
      In this case, the one that started earlier, will not be killed, when the hive session closes, consuming resources.

        Attachments

        1. HIVE-21035.01.patch
          7 kB
          Antal Sinkovits
        2. HIVE-21035.02.patch
          7 kB
          Antal Sinkovits

          Activity

            People

            • Assignee:
              asinkovits Antal Sinkovits
              Reporter:
              asinkovits Antal Sinkovits
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: