Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15815

Allow to pass some Oozie properties to Spark in HoS

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.3.0
    • Diagnosability, Spark
    • None

    Description

      Oozie passes some of its properties (e.g. oozie.job.id) to Beeline/HS2 when it invokes Hive2 action. If we allow these properties to be passed to Spark in HoS, we can easily associate an Ooize workflow ID to an HoS client and Spark job in Spark history. It will be very helpful in diagnosing some issues involving Oozie Hive2/HoS/Spark.

      Attachments

        1. HIVE-15815.patch
          1 kB
          Chaoyu Tang
        2. HIVE-15815.patch
          1 kB
          Chaoyu Tang
        3. HIVE-15815.1.patch
          1 kB
          Chaoyu Tang

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. OOZIE-2786 Pass Oozie workflow ID and settings to Spark application configuration

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              ctang Chaoyu Tang
              ctang Chaoyu Tang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: