Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2915 Enable YARN RM scale out via federation using multiple RM's
  3. YARN-5411

Create a proxy chain for ApplicationClientProtocol in the Router

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      As detailed in the proposal in the umbrella JIRA, we are introducing a new component that routes client request to appropriate ResourceManager(s). This JIRA tracks the creation of a proxy for ApplicationClientProtocol in the Router. This provides a placeholder for:
      1) throttling mis-behaving clients (YARN-1546)
      3) mask the access to multiple RMs (YARN-3659)

      We are planning to follow the interceptor pattern like we did in YARN-2884 to generalize the approach and have only dynamically coupling for Federation.

      Attachments

        1. YARN-5411-YARN-2915.v1.patch
          127 kB
          Giovanni Matteo Fumarola
        2. YARN-5411-YARN-2915.v2.patch
          166 kB
          Giovanni Matteo Fumarola
        3. YARN-5411-YARN-2915.v3.patch
          166 kB
          Giovanni Matteo Fumarola
        4. YARN-5411-YARN-2915.v4.patch
          166 kB
          Giovanni Matteo Fumarola
        5. YARN-5411-YARN-2915.v5.patch
          156 kB
          Giovanni Matteo Fumarola
        6. YARN-5411-YARN-2915.v6.patch
          158 kB
          Giovanni Matteo Fumarola
        7. YARN-5411-YARN-2915.v7.patch
          158 kB
          Giovanni Matteo Fumarola

        Issue Links

          is related to

          Sub-task - The sub-task of the issue YARN-1546 Prevent DoS of ApplicationClientProtocol by putting in limits

          • Major - Major loss of function.
          • Open

          Sub-task - The sub-task of the issue YARN-2884 Proxying all AM-RM communications

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-3659 Federation: routing client invocations transparently to multiple RMs

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              giovanni.fumarola Giovanni Matteo Fumarola
              subru Subramaniam Krishnan
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: