Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2628

History logging plugin to write ATS events to HDFS

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      This provides another history logging alternative that conceptually the same as the timeline logging service but logs the entities to a file rather than posting the events to the timeline server directly. When coupled with the timeline store plugin from YARN-3942 it allows the Tez job to be decoupled from the timeline server yet the Tez UI can still function properly.

      Attachments

        1. TEZ-2628.001.patch
          35 kB
          Jason Darrell Lowe
        2. hive-timeline.json
          3 kB
          Hitesh Shah
        3. TEZ-2628.002.patch
          34 kB
          Jason Darrell Lowe
        4. TEZ-2628.003.patch
          34 kB
          Jason Darrell Lowe
        5. TEZ-2628.004.patch
          34 kB
          Jason Darrell Lowe

        Issue Links

          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. TEZ-2319 DAG history in HDFS

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue YARN-3942 Timeline store to read events from HDFS

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              jlowe Jason Darrell Lowe
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated: