Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8896

expose (hadoop/tez) job ids in API

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • Clients
    • None

    Description

      In many cases it would be very useful to be able to map the hadoop/tez jobs back to a query that was executed/is currently being executed. Especially when hive queries are run within a bigger process the ability to get the job ids and query for counters is very beneficial to projects embeddding hive.

      I saw that cloudera's hue is parsing the logs produced by hive in order to get to the job ids. That seems rather brittle and can easily break, whenever the log format changes. Exposing the jobids in the API would make it a lot easier to build integrations like hue.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              fs111 André Kelpe
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: