Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-20790

SparkSession should be able to close a session while it is being opened

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Spark
    • None

    Description

      InĀ HIVE-14162 we adding locks to SparkSessionImpl to support scenarios where we want to close the session due to a timeout. However, the locks remove the ability to close a session while it is being opened. This is important to allow cancelling of a session while it is being setup. This can be useful on busy clusters where there may not be enough YARN containers to setup the Spark Remote Driver.

      Attachments

        Issue Links

          Activity

            People

              asinkovits Antal Sinkovits
              stakiar Sahil Takiar
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: