Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12538

After set spark related config, SparkSession never get reused

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0
    • Fix Version/s: 2.1.0
    • Component/s: Spark
    • Labels:
      None

      Description

      Hive on Spark yarn-cluster mode.
      After setting "set spark.yarn.queue=QueueA;" ,
      run the query "select count from test" 3 times and you will find 3 different yarn applications.
      Two of the yarn applications in FINISHED & SUCCEEDED state,and one in RUNNING & UNDEFINED state waiting for next work.
      And if you submit one more "select count from test" ,the third one will be in FINISHED & SUCCEEDED state and a new yarn application will start up.

        Attachments

        1. HIVE-12538.patch
          5 kB
          Nemon Lou
        2. HIVE-12538.1.patch
          4 kB
          Nemon Lou
        3. HIVE-12538.2.patch
          4 kB
          Nemon Lou
        4. HIVE-12538.3.patch
          4 kB
          Nemon Lou
        5. HIVE-12538.4.patch
          5 kB
          Nemon Lou
        6. HIVE-12538.5.patch
          3 kB
          Nemon Lou

          Activity

            People

            • Assignee:
              nemon Nemon Lou
              Reporter:
              nemon Nemon Lou
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: