Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2915 Enable YARN RM scale out via federation using multiple RM's
  3. YARN-5411

Create a proxy chain for ApplicationClientProtocol in the Router

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      As detailed in the proposal in the umbrella JIRA, we are introducing a new component that routes client request to appropriate ResourceManager(s). This JIRA tracks the creation of a proxy for ApplicationClientProtocol in the Router. This provides a placeholder for:
      1) throttling mis-behaving clients (YARN-1546)
      3) mask the access to multiple RMs (YARN-3659)

      We are planning to follow the interceptor pattern like we did in YARN-2884 to generalize the approach and have only dynamically coupling for Federation.

      Attachments

        1. YARN-5411-YARN-2915.v7.patch
          158 kB
          Giovanni Matteo Fumarola
        2. YARN-5411-YARN-2915.v6.patch
          158 kB
          Giovanni Matteo Fumarola
        3. YARN-5411-YARN-2915.v5.patch
          156 kB
          Giovanni Matteo Fumarola
        4. YARN-5411-YARN-2915.v4.patch
          166 kB
          Giovanni Matteo Fumarola
        5. YARN-5411-YARN-2915.v3.patch
          166 kB
          Giovanni Matteo Fumarola
        6. YARN-5411-YARN-2915.v2.patch
          166 kB
          Giovanni Matteo Fumarola
        7. YARN-5411-YARN-2915.v1.patch
          127 kB
          Giovanni Matteo Fumarola

        Issue Links

        is related to

        Sub-task - The sub-task of the issue YARN-1546 Prevent DoS of ApplicationClientProtocol by putting in limits

        • Major - Major loss of function.
        • Open

        Sub-task - The sub-task of the issue YARN-2884 Proxying all AM-RM communications

        • Major - Major loss of function.
        • Resolved

        Sub-task - The sub-task of the issue YARN-3659 Federation: routing client invocations transparently to multiple RMs

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            giovanni.fumarola Giovanni Matteo Fumarola Assign to me
            subru Subramaniam Krishnan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment