Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1530

[Umbrella] Store, manage and serve per-framework application-timeline data

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      This is a sibling JIRA for YARN-321.

      Today, each application/framework has to do store, and serve per-framework data all by itself as YARN doesn't have a common solution. This JIRA attempts to solve the storage, management and serving of per-framework data from various applications, both running and finished. The aim is to change YARN to collect and store data in a generic manner with plugin points for frameworks to do their own thing w.r.t interpretation and serving.

      Attachments

        1. application timeline design-20140108.pdf
          82 kB
          Vinod Kumar Vavilapalli
        2. application timeline design-20140116.pdf
          86 kB
          Billie Rinaldi
        3. application timeline design-20140130.pdf
          91 kB
          Billie Rinaldi
        4. application timeline design-20140210.pdf
          93 kB
          Billie Rinaldi
        5. ATS-meet-up-8-28-2014-notes.pdf
          80 kB
          Sangjin Lee
        6. ATS-Write-Pipeline-Design-Proposal.pdf
          71 kB
          Robert Kanter

        Issue Links

          is depended upon by

          Task - A task that needs to be done. MAPREDUCE-5858 [Umbrella] MR should make use of the timeline server

          • Major - Major loss of function.
          • Open
          is related to

          Sub-task - The sub-task of the issue YARN-1744 Renaming applicationhistoryservice module

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-1701 Improve default paths of timeline store and generic history store

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. SPARK-1537 Add integration with Yarn's Application Timeline Server

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-1935 Security for timeline server

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-321 [Umbrella] Generic application history service

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-3539 Compatibility doc to state that ATS v1 is a stable REST API

          • Major - Major loss of function.
          • Closed

          Task - A task that needs to be done. YARN-1452 Document the usage of the generic application history and the timeline data service

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-7076 Plugin (exec hook) to log to application timeline data to Yarn

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. YARN-2928 YARN Timeline Service v.2: alpha 1

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          There are no Sub-Tasks for this issue.

          Activity

            People

              Unassigned Unassigned
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              74 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: