Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2877 Extend YARN to support distributed scheduling
  3. YARN-5090

Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1
    • None
    • None

    Description

      Validates End2End Distributed Scheduling flow which includes

      1. the AM specifying OPPORTUNISTIC containers in its resource requests (YARN-2882, YARN-4335)
      2. the Request intercepted by the AMRMProxyService running on the NM and handled by the LocalScheduler RequestInterceptor (YARN-2884, YARN-2885)
      3. use of the DistributedSchedulingProtocol to talk to the DistributedSchedulingService running on the RM to obtain list of lightly loaded Nodes (YARN-2885, YARN-4412)
      4. use of the OpportunisticContainerAllocator to create Container tokens which are returned to the AM (YARN-2885)

      Attachments

        1. mvn_test_2.txt
          108 kB
          Arun Suresh
        2. mvn_test.txt
          108 kB
          Arun Suresh
        3. YARN-5090.001.patch
          15 kB
          Arun Suresh
        4. YARN-5090.002.patch
          22 kB
          Arun Suresh
        5. YARN-5090.002.patch
          22 kB
          Arun Suresh

        Activity

          People

            asuresh Arun Suresh
            asuresh Arun Suresh
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: