Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-14162

Allow disabling of long running job on Hive On Spark On YARN

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: Spark
    • Labels:
      None

      Description

      Hive On Spark launches a long running process on the first query to handle all queries for that user session. In some use cases this is not desired, for instance when using Hue with large intervals between query executions.

      Could we have a property that would cause long running spark jobs to be terminated after each query execution and started again for the next one?

        Attachments

        1. HIVE-14162.9.patch
          28 kB
          Sahil Takiar
        2. HIVE-14162.8.patch
          28 kB
          Sahil Takiar
        3. HIVE-14162.7.patch
          24 kB
          Sahil Takiar
        4. HIVE-14162.6.patch
          24 kB
          Sahil Takiar
        5. HIVE-14162.5.patch
          24 kB
          Sahil Takiar
        6. HIVE-14162.4.patch
          24 kB
          Sahil Takiar
        7. HIVE-14162.3.patch
          18 kB
          Sahil Takiar
        8. HIVE-14162.2.patch
          14 kB
          Sahil Takiar
        9. HIVE-14162.1.patch
          5 kB
          Aihua Xu

          Issue Links

            Activity

              People

              • Assignee:
                stakiar Sahil Takiar
                Reporter:
                tscott@cloudera.com Thomas Scott
              • Votes:
                2 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: