Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-15815

Allow to pass some Oozie properties to Spark in HoS

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.3.0
    • Component/s: Diagnosability, Spark
    • Labels:
      None

      Description

      Oozie passes some of its properties (e.g. oozie.job.id) to Beeline/HS2 when it invokes Hive2 action. If we allow these properties to be passed to Spark in HoS, we can easily associate an Ooize workflow ID to an HoS client and Spark job in Spark history. It will be very helpful in diagnosing some issues involving Oozie Hive2/HoS/Spark.

        Attachments

        1. HIVE-15815.1.patch
          1 kB
          Chaoyu Tang
        2. HIVE-15815.patch
          1 kB
          Chaoyu Tang
        3. HIVE-15815.patch
          1 kB
          Chaoyu Tang

          Issue Links

            Activity

              People

              • Assignee:
                ctang Chaoyu Tang
                Reporter:
                ctang Chaoyu Tang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: