Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2915 Enable YARN RM scale out via federation using multiple RM's
  3. YARN-6511

Federation: transparently spanning application across multiple sub-clusters

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-beta1
    • None
    • None
    • Reviewed

    Description

      In order to support transparent "spanning" of jobs across sub-clusters, all AM-RM communications are proxied (via YARN-2884).

      This JIRA tracks federation-specific mechanisms that decide how to "split/broadcast" requests to the RMs and "merge" answers to
      the AM.

      This the part two jira, which adds secondary subclusters and do full split-merge for requests. Part one is in YARN-3666

      Attachments

        1. YARN-6511-YARN-2915.v1.patch
          66 kB
          Botong Huang
        2. YARN-6511-YARN-2915.v2.patch
          66 kB
          Botong Huang
        3. YARN-6511-YARN-2915.v3.patch
          60 kB
          Botong Huang

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue YARN-5531 UnmanagedAM pool manager for federating application across clusters

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Sub-task - The sub-task of the issue YARN-3666 Federation Intercepting and propagating AM- home RM communications

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              botong Botong Huang
              botong Botong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: