Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9802

YARN Timeline Service v2 (post GA features)

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Epic jira to track new feature enhancements or issues after the next release of Timeline Service v2

        Attachments

          Issue Links

          1.
          Support ACLs in ATSv2 Sub-task In Progress Vrushali C
          2.
          Support metric filters for flow runs Sub-task In Progress Varun Saxena
          3.
          Recover domain from backend for TimelineCollector. Sub-task In Progress Haibo Chen
          4.
          [atsv2 read acls] Coprocessor for reader authorization check Sub-task In Progress Vrushali C
          5.
          HBaseTimelineSchemaCreator has to allow user to configure pre-splits Sub-task Patch Available Prabhu Joseph
          6.
          AM get timeline service info from RM rather than Application specific configuration. Sub-task Patch Available Abhishek Modi
          7.
          GET /apps/{appid}/entities/YARN_APPLICATION accesses application table instead of entity table Sub-task Patch Available Prabhu Joseph
          8.
          Use hbase shaded jars Sub-task In Progress Vrushali C
          9.
          Use app user to publish entities from NM Sub-task Patch Available Varun Saxena
          10.
          Support for listing flows with filter userid Sub-task Patch Available Haibo Chen
          11.
          [Fault tolerance] Fault tolerant writer for timeline v2 Sub-task In Progress Joep Rottinghuis
          12.
          [atsv2 read acls] REST API to list domain/domains Sub-task Patch Available Abhishek Modi
          13.
          @Path("/apps/{appid}/appattempts") error message misleads Sub-task Patch Available Prabhu Joseph
          14.
          Do ACLs check for flowrun entities Sub-task Open Abhishek Modi
          15.
          Enable timeline collector fault tolerance Sub-task Open Unassigned
          16.
          [atsv2 read acls] Update timeline collector to include domain for entities Sub-task Open Abhishek Modi
          17.
          [atsv2 read acls] Update NM to include ACLs for system entities Sub-task Open Prabhu Joseph
          18.
          [Security] users should not be able to create a generic TimelineEntity and associate arbitrary type Sub-task Open Haibo Chen
          19.
          Do ACLs check for flow activity entities Sub-task Open Abhishek Modi
          20.
          [ATSv2 Security] Delegation token support for Timeline reader Sub-task Open Varun Saxena
          21.
          Do ACLs check for generic entities Sub-task Open Haibo Chen
          22.
          Support for new REST end point /clusterids Sub-task Open Sushil Ks
          23.
          [atsv2 read acls] Enable hbase writer to store domain/ACLs info Sub-task Open Prabhu Joseph
          24.
          [atsv2 read acls] Add a API TimelineV2Client#putDomain to publish domain information. Sub-task Open Unassigned
          25.
          Allow YARN ATSv2 ACLs to be disabled Sub-task Open Unassigned
          26.
          Timeline service v2 integration with Federation Sub-task Open Abhishek Modi
          27.
          Add a yarn application cost calculation framework in TimelineService v2 Sub-task Open Sushil Ks
          28.
          Do ACLs check for sub app entities Sub-task Open Abhishek Modi
          29.
          [ATSv2 Security] Use token for communication between NM and node collector Sub-task Open Unassigned
          30.
          [ATSv2 Security] Consider using delegation token for publishing entities from NM Sub-task Open Abhishek Modi
          31.
          create a REST API that returns the clusters for a given app id Sub-task Open Sushil Ks
          32.
          Do ACLs check for application entities Sub-task Open Abhishek Modi
          33.
          Support substring match in filters Sub-task Open Prabhu Joseph
          34.
          Publish federation events to ATSv2. Sub-task Open Abhishek Modi
          35.
          Launch app collectors for unmanaged AMs' Sub-task Open Abhishek Modi
          36.
          Coprocessor related code changes/cleanup pending HBASE-17273 Sub-task Open Vrushali C
          37.
          Improve debugging on ATSv2 reader server Sub-task Open Haibo Chen
          38.
          Final Status of applications shown as UNDEFINED in ATS app queries Sub-task Reopened Prabhu Joseph
          39.
          Support data retention policy in YARN ATSv2 Sub-task Open Unassigned
          40.
          Writing more RM side app-level metrics Sub-task Open Naganarasimha G R
          41.
          Support for collapse filter for flow entities with in the boundary of date range. Sub-task Open Unassigned
          42.
          Review / Recommendations for hbase writer code Sub-task Open Vrushali C
          43.
          Issues with HBaseTimelineWriterImpl in single node hadoop & hbase cluster Sub-task Open Vrushali C
          44.
          refactor ColumnHelper read* methods Sub-task Open Vrushali C
          45.
          Support for listing all applications i.e /apps Sub-task Open Unassigned
          46.
          Documentation updates for branch2 Timeline Service V2 Sub-task Open Unassigned
          47.
          Timeline entity uniqueness Sub-task Open Vrushali C
          48.
          Limit flow runs returned while querying flows Sub-task Open Varun Saxena
          49.
          Support Multiple versions of the timeline service at the same time Sub-task Open Unassigned
          50.
          Update timeline collector to store and add domain info to entities while writing Sub-task Open Abhishek Modi
          51.
          Scalability validation of RM writing app/attempt/container lifecycle events Sub-task Open Unassigned
          52.
          AMs are unable to publish events if NMCollectorService starts at dynamic port. Sub-task Open Abhishek Modi
          53.
          Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting Sub-task Open Vrushali C
          54.
          Address race condition on TimelineWriter.flush() caused by buffer-sized flush Sub-task Open Yousef Abu-Salah
          55.
          Bubble exceptions and errors all the way up the calls, including to clients. Sub-task Open Haibo Chen
          56.
          Extend aggregation operation for new ATS design Sub-task Open Linlin Zhou
          57.
          timeline flow runs API createdtimestart/createdtimeend parameter does not work Sub-task Open Unassigned
          58.
          Writing RM cluster-level metrics Sub-task Open Zhijie Shen
          59.
          Support UNIT for TimelineMetric Sub-task Open Unassigned
          60.
          Provide generic log servlet for serving logs Sub-task Open Abhishek Modi
          61.
          Make async/sync writes to timeline service configurable Sub-task Open Unassigned
          62.
          create the flow-version table Sub-task Open Vrushali C
          63.
          Consider adding a config setting to accept logical cluster name Sub-task Open Sushil Ks
          64.
          Optimize and synchronize FS Reader and Writer Implementations Sub-task Open Varun Saxena
          65.
          Timeline client won't be able to write when TimelineCollector is not up yet, or NM is down Sub-task Open Vrushali C
          66.
          Inline java doc with Hadoop formatter Sub-task Open WEI-HSIAO-LEE
          67.
          Ensure the final values for metrics/events are emitted/stored at APP completion time Sub-task Open Vrushali C
          68.
          Support to alter table properties in HBaseTimelineSchemaCreator Sub-task Open Tarun Parimi
          69.
          Enhance hbase coprocessor aggregation operations:GLOBAL_MIN, LATEST_MIN etc and FINAL attributes Sub-task Open Vrushali C
          70.
          TestTimelineReaderWebServices times out on YARN-5355_branch2 Sub-task Open Unassigned
          71.
          Have a separate NM timeline publishing-interval Sub-task Open Naganarasimha G R
          72.
          Change collector discovery to support collectors mapped to clients but not applications Sub-task Open Li Lu
          73.
          offline collector: support timeline clients not associated with an application Sub-task Open Unassigned
          74.
          [Atsv2] Support streaming reader API to fetch entities Sub-task Open Unassigned
          75.
          Support long running apps handling multiple flows Sub-task Open Varun Saxena
          76.
          TimelineCollectorWebService#putEntities blocked when ATSV2 HBase is down. Sub-task Patch Available Prabhu Joseph
          77.
          TimelineService Hbase tests are failing Sub-task Open Prabhu Joseph
          78.
          TimelineSchemaCreator breaks after protobuffer upgrade Sub-task Open Unassigned
          79.
          Region in ats-hbase table 'prod.timelineservice.entity' failing to split Sub-task Open Unassigned

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                vrushalic Vrushali C
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated: