Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8548 Integrate with remote Spark context after HIVE-8528 [Spark Branch]
  3. HIVE-8957

Remote spark context needs to clean up itself in case of connection timeout [Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Spark
    • None

    Description

      In the current SparkClient implementation (class SparkClientImpl), the constructor does some initialization and in the end waits for the remote driver to connect. In case of timeout, it just throws an exception without cleaning itself. The cleanup is necessary to release system resources.

      Attachments

        1. HIVE-8957.1-spark.patch
          0.5 kB
          Xuefu Zhang

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HIVE-8951 Spark remote context doesn't work with local-cluster [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              xuefuz Xuefu Zhang
              xuefuz Xuefu Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: