Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12538

After set spark related config, SparkSession never get reused

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.3.0
    • 2.1.0
    • Spark
    • None

    Description

      Hive on Spark yarn-cluster mode.
      After setting "set spark.yarn.queue=QueueA;" ,
      run the query "select count from test" 3 times and you will find 3 different yarn applications.
      Two of the yarn applications in FINISHED & SUCCEEDED state,and one in RUNNING & UNDEFINED state waiting for next work.
      And if you submit one more "select count from test" ,the third one will be in FINISHED & SUCCEEDED state and a new yarn application will start up.

      Attachments

        1. HIVE-12538.1.patch
          4 kB
          Nemon Lou
        2. HIVE-12538.2.patch
          4 kB
          Nemon Lou
        3. HIVE-12538.3.patch
          4 kB
          Nemon Lou
        4. HIVE-12538.4.patch
          5 kB
          Nemon Lou
        5. HIVE-12538.5.patch
          3 kB
          Nemon Lou
        6. HIVE-12538.patch
          5 kB
          Nemon Lou

        Activity

          People

            nemon Nemon Lou
            nemon Nemon Lou
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: