Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      This umbrella JIRA tracks set of improvements over the YARN Federation MVP (YARN-2915)

        Issue Links

        1. Federation maintenance mechanisms (simple CLI and command propagation) Sub-task Open Carlo Curino
         
        2. Federation "Capacity Allocation" across sub-cluster Sub-task Open Carlo Curino
         
        3. Federation Global Policy Generator (load balancing) Sub-task Open Subru Krishnan
         
        4. Metrics for Federation StateStore Sub-task Patch Available Ellen Hui
         
        5. Add versioning for FederationStateStore Sub-task Open Unassigned
         
        6. New ResourceCalculator implementation that operates on vector of resources, but respect sum of ratios Sub-task Open Unassigned
         
        7. Add support for reservation-based routing. Sub-task Patch Available Carlo Curino
         
        8. Add support for AMRMProxy HA Sub-task Open Subru Krishnan
         
        9. Advanced Federation UI based on YARN UI v2 Sub-task Open Tanuj Nayak
         
        10. Refactoring SQLFederationStateStore by avoiding to recreate the connections at every call Sub-task Open Unassigned
         
        11. Consider running RM tests against the Router Sub-task Open Unassigned
         
        12. Create SecureLogin inside Router Sub-task Open Unassigned
         
        13. Replace MockResourceManagerFacade with MockRM for AMRMProxy/Router tests Sub-task Open Unassigned
         
        14. Refactoring Router services to use common util classes for pipeline creations Sub-task Open Unassigned
         
        15. Add FederationStateStore interfaces for Global Policy Generator Sub-task Patch Available Botong Huang
         
        16. Handle containerId duplicate without failing the heartbeat in Federation Interceptor Sub-task Open Botong Huang
         
        17. Federation Router (hiding multiple RMs for ApplicationClientProtocol) phase 2 Sub-task Open Unassigned
         
        18.
        Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution) Sub-task Resolved Giovanni Matteo Fumarola
         
        19.
        ZooKeeper based implementation of the FederationStateStore Sub-task Resolved Íñigo Goiri
         
        20. Metrics for Federation Router Sub-task Patch Available Giovanni Matteo Fumarola
         
        21. Metrics for Federation AMRMProxy Sub-task Open Botong Huang
         
        22. Add Federation Interceptor restart when work preserving NM is enabled Sub-task Patch Available Botong Huang
         
        23.
        Handle concurrent register AM requests in FederationInterceptor Sub-task Resolved Botong Huang
         
        24. Add support for updateContainers when allocating using FederationInterceptor Sub-task Patch Available Botong Huang
         
        25.
        Add PoolInitializationException as retriable exception in FederationFacade Sub-task Resolved Giovanni Matteo Fumarola
         
        26. Adding RM ClusterId in AppInfo Sub-task Patch Available Tanuj Nayak
         
        27. Adding RM Cluster Id in ApplicationReport Sub-task Open Unassigned
         
        28. Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps) Sub-task Open Giovanni Matteo Fumarola
         

          Activity

          There are no comments yet on this issue.

            People

            • Assignee:
              subru Subru Krishnan
              Reporter:
              subru Subru Krishnan
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:

                Development