Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2877 Extend YARN to support distributed scheduling
  3. YARN-5090

Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None

      Description

      Validates End2End Distributed Scheduling flow which includes

      1. the AM specifying OPPORTUNISTIC containers in its resource requests (YARN-2882, YARN-4335)
      2. the Request intercepted by the AMRMProxyService running on the NM and handled by the LocalScheduler RequestInterceptor (YARN-2884, YARN-2885)
      3. use of the DistributedSchedulingProtocol to talk to the DistributedSchedulingService running on the RM to obtain list of lightly loaded Nodes (YARN-2885, YARN-4412)
      4. use of the OpportunisticContainerAllocator to create Container tokens which are returned to the AM (YARN-2885)

        Attachments

        1. YARN-5090.002.patch
          22 kB
          Arun Suresh
        2. YARN-5090.002.patch
          22 kB
          Arun Suresh
        3. YARN-5090.001.patch
          15 kB
          Arun Suresh
        4. mvn_test.txt
          108 kB
          Arun Suresh
        5. mvn_test_2.txt
          108 kB
          Arun Suresh

          Activity

            People

            • Assignee:
              asuresh Arun Suresh
              Reporter:
              asuresh Arun Suresh
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: