Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-7439

Spark job monitoring and error reporting [Spark Branch]

    XMLWordPrintableJSON

Details

    Description

      After Hive submits a job to Spark cluster, we need to report to user the job progress, such as the percentage done, to the user. This is especially important for long running queries. Moreover, if there is an error during job submission or execution, it's also crucial for hive to fetch the error log and/or stacktrace and feedback it to the user.

      Please refer design doc on wiki for more information.

      CLEAR LIBRARY CACHE

      Attachments

        1. hive on spark job status.PNG
          34 kB
          Chengxiang Li
        2. HIVE-7439.3-spark.patch
          27 kB
          Chengxiang Li
        3. HIVE-7439.3-spark.patch
          27 kB
          Xuefu Zhang
        4. HIVE-7439.2-spark.patch
          27 kB
          Chengxiang Li
        5. HIVE-7439.2-spark.patch
          27 kB
          Xuefu Zhang
        6. HIVE-7439.1-spark.patch
          26 kB
          Chengxiang Li

        Issue Links

          Activity

            People

              chengxiang li Chengxiang Li
              xuefuz Xuefu Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: