Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-beta1
    • Component/s: timelineserver
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      We are releasing the alpha2 version of a major revision of YARN Timeline Service: v.2. YARN Timeline Service v.2 addresses two major challenges: improving scalability and reliability of Timeline Service, and enhancing usability by introducing flows and aggregation.

      YARN Timeline Service v.2 alpha1 was introduced in 3.0.0-alpha1 via YARN-2928.

      YARN Timeline Service v.2 alpha2 is now being provided so that users and developers can test it and provide feedback and suggestions for making it a ready replacement for Timeline Service v.1.x. Security is provided via Kerberos Authentication and delegation tokens. There is also a simple read level authorization provided via whitelists.

      Some of the notable improvements since alpha-1 are:
      - Security via Kerberos Authentication and delegation tokens
      - Read side simple authorization via whitelist
      - Client configurable entity sort ordering
      - New REST APIs for apps, app attempts, containers, fetching metrics by timerange, pagination, sub-app entities
      - Support for storing sub-application entities (entities that exist outside the scope of an application)
      - Configurable TTLs (time-to-live) for tables, configurable table prefixes, configurable hbase cluster
      - Flow level aggregations done as dynamic (table level) coprocessors
      - Uses latest stable HBase release 1.2.6

      More details are available in the [YARN Timeline Service v.2](./hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html) documentation.
      Show
      We are releasing the alpha2 version of a major revision of YARN Timeline Service: v.2. YARN Timeline Service v.2 addresses two major challenges: improving scalability and reliability of Timeline Service, and enhancing usability by introducing flows and aggregation. YARN Timeline Service v.2 alpha1 was introduced in 3.0.0-alpha1 via YARN-2928 . YARN Timeline Service v.2 alpha2 is now being provided so that users and developers can test it and provide feedback and suggestions for making it a ready replacement for Timeline Service v.1.x. Security is provided via Kerberos Authentication and delegation tokens. There is also a simple read level authorization provided via whitelists. Some of the notable improvements since alpha-1 are: - Security via Kerberos Authentication and delegation tokens - Read side simple authorization via whitelist - Client configurable entity sort ordering - New REST APIs for apps, app attempts, containers, fetching metrics by timerange, pagination, sub-app entities - Support for storing sub-application entities (entities that exist outside the scope of an application) - Configurable TTLs (time-to-live) for tables, configurable table prefixes, configurable hbase cluster - Flow level aggregations done as dynamic (table level) coprocessors - Uses latest stable HBase release 1.2.6 More details are available in the [YARN Timeline Service v.2](./hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html) documentation.

      Description

      This is an umbrella JIRA for the alpha 2 milestone for YARN Timeline Service v.2.

      This is developed on feature branches: YARN-5355 for the trunk-based development and YARN-5355-branch-2 to maintain backports to branch-2. Any subtask work on this JIRA will be committed to those 2 branches.

        Attachments

        1. Timeline Service v2_ Ideas for Next Steps.pdf
          132 kB
          Sangjin Lee
        2. YARN-5355-branch-2.01.patch
          2.36 MB
          Vrushali C
        3. YARN-5355.01.patch
          1.21 MB
          Varun Saxena
        4. YARN-5355.02.patch
          1.21 MB
          Varun Saxena
        5. YARN-5355.03.patch
          1.21 MB
          Varun Saxena
        6. Documentation - The YARN Timeline Service v2.pdf
          297 kB
          Varun Saxena

          Issue Links

            Activity

              People

              • Assignee:
                vrushalic Vrushali C
                Reporter:
                sjlee0 Sangjin Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                22 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: