Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5597

YARN Federation improvements

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • federation
    • Reviewed
    • Hide
      We have enhanced the YARN Federation functionality for improved usability. The enhanced features are as follows:
      1. YARN Router now boasts a full implementation of all interfaces including the ApplicationClientProtocol, ResourceManagerAdministrationProtocol, and RMWebServiceProtocol.
      2. YARN Router support for application cleanup and automatic offline mechanisms for subCluster.
      3. Code improvements were undertaken for the Router and AMRMProxy, along with enhancements to previously pending functionalities.
      4. Audit logs and Metrics for Router received upgrades.
      5. A boost in cluster security features was achieved, with the inclusion of Kerberos support.
      6. The page function of the router has been enhanced.
      7. A set of commands has been added to the Router side for operating on SubClusters and Policies.
      Show
      We have enhanced the YARN Federation functionality for improved usability. The enhanced features are as follows: 1. YARN Router now boasts a full implementation of all interfaces including the ApplicationClientProtocol, ResourceManagerAdministrationProtocol, and RMWebServiceProtocol. 2. YARN Router support for application cleanup and automatic offline mechanisms for subCluster. 3. Code improvements were undertaken for the Router and AMRMProxy, along with enhancements to previously pending functionalities. 4. Audit logs and Metrics for Router received upgrades. 5. A boost in cluster security features was achieved, with the inclusion of Kerberos support. 6. The page function of the router has been enhanced. 7. A set of commands has been added to the Router side for operating on SubClusters and Policies.
    • Important

    Description

      This umbrella JIRA tracks set of improvements over the YARN Federation MVP (YARN-2915)

      Attachments

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. YARN-2915 Enable YARN RM scale out via federation using multiple RM's

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue YARN-10229 [Federation] Client should be able to submit application to RM directly using normal client conf

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-10900 Yarn nodes missing from router web app

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-9708 Yarn Router Support DelegationToken

          • Major - Major loss of function.
          • Patch Available

          Wish - General wishlist item. YARN-9586 [QA] Need more doc for yarn.federation.policy-manager-params when LoadBasedRouterPolicy is used

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-8435 Fix NPE when the same client simultaneously contact for the first time Yarn Router

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-8596 Allow SQLFederationStateStore to submit the same app in the same subcluster

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-8434 Update federation documentation of Nodemanager configurations

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-7402 Federation V2: Global Optimizations

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. YARN-10885 Make FederationStateStoreFacade#getApplicationHomeSubCluster use JCache

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-11333 Federation: Improve Yarn Router Web Page

          • Major - Major loss of function.
          • Resolved
          There are no Sub-Tasks for this issue.

          Activity

            People

              subru Subramaniam Krishnan
              subru Subramaniam Krishnan
              Votes:
              0 Vote for this issue
              Watchers:
              29 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 43h 20m
                  43h 20m