• Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:


      This umbrella JIRA tracks set of improvements over the YARN Federation MVP (YARN-2915)

        Issue Links

        1. Federation maintenance mechanisms (simple CLI and command propagation) Sub-task Open Carlo Curino
        2. Federation "Capacity Allocation" across sub-cluster Sub-task Open Carlo Curino
        3. Federation Global Policy Generator (load balancing) Sub-task Open Subru Krishnan
        4. Metrics for Federation StateStore Sub-task Patch Available Ellen Hui
        5. Add versioning for FederationStateStore Sub-task Open Unassigned
        6. New ResourceCalculator implementation that operates on vector of resources, but respect sum of ratios Sub-task Open Unassigned
        7. Add support for reservation-based routing. Sub-task Patch Available Carlo Curino
        8. Add support for AMRMProxy HA Sub-task Open Subru Krishnan
        9. Advanced Federation UI based on YARN UI v2 Sub-task Open Tanuj Nayak
        10. Refactoring SQLFederationStateStore by avoiding to recreate the connections at every call Sub-task Open Unassigned
        11. Consider running RM tests against the Router Sub-task Open Unassigned
        12. Create SecureLogin inside Router Sub-task Open Unassigned
        13. Replace MockResourceManagerFacade with MockRM for AMRMProxy/Router tests Sub-task Open Unassigned
        14. Refactoring Router services to use common util classes for pipeline creations Sub-task Open Unassigned
        15. Add FederationStateStore interfaces for Global Policy Generator Sub-task Patch Available Botong Huang
        16. Handle containerId duplicate without failing the heartbeat in Federation Interceptor Sub-task Open Botong Huang
        17. Federation Router (hiding multiple RMs for ApplicationClientProtocol) phase 2 Sub-task Open Unassigned
        Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution) Sub-task Resolved Giovanni Matteo Fumarola
        ZooKeeper based implementation of the FederationStateStore Sub-task Resolved Íñigo Goiri
        20. Metrics for Federation Router Sub-task Patch Available Giovanni Matteo Fumarola
        21. Metrics for Federation AMRMProxy Sub-task Open Botong Huang
        22. Add Federation Interceptor restart when work preserving NM is enabled Sub-task Patch Available Botong Huang
        Handle concurrent register AM requests in FederationInterceptor Sub-task Resolved Botong Huang
        24. Add support for updateContainers when allocating using FederationInterceptor Sub-task Patch Available Botong Huang
        Add PoolInitializationException as retriable exception in FederationFacade Sub-task Resolved Giovanni Matteo Fumarola
        26. Adding RM ClusterId in AppInfo Sub-task Patch Available Tanuj Nayak
        27. Adding RM Cluster Id in ApplicationReport Sub-task Open Unassigned
        28. Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps) Sub-task Open Giovanni Matteo Fumarola


          There are no comments yet on this issue.


            • Assignee:
              subru Subru Krishnan
              subru Subru Krishnan
            • Votes:
              0 Vote for this issue
              12 Start watching this issue


              • Created: