Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7451

Resources Types should be visible in the Cluster Apps API "resourceRequests" section

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0
    • Fix Version/s: None
    • Component/s: resourcemanager, restapi
    • Labels:
      None
    • Target Version/s:

      Description

      When running jobs that request resource types the RM Cluster Apps API should include this in the "resourceRequests" object.

      Additionally, when calling the RM scheduler API it returns:

       "childQueues": {
                                      "queue": [
                                          {
                                              "allocatedContainers": 101,
                                              "amMaxResources": {
                                                  "memory": 320390,
                                                  "vCores": 192
                                              },
                                              "amUsedResources": {
                                                  "memory": 1024,
                                                  "vCores": 1
                                              },
                                              "clusterResources": {
                                                  "memory": 640779,
                                                  "vCores": 384
                                              },
                                              "demandResources": {
                                                  "memory": 103424,
                                                  "vCores": 101
                                              },
                                              "fairResources": {
                                                  "memory": 640779,
                                                  "vCores": 384
                                              },
                                              "maxApps": 2147483647,
                                              "maxResources": {
                                                  "memory": 640779,
                                                  "vCores": 384
                                              },
                                              "minResources": {
                                                  "memory": 0,
                                                  "vCores": 0
                                              },
                                              "numActiveApps": 1,
                                              "numPendingApps": 0,
                                              "preemptable": true,
                                              "queueName": "root.users.systest",
                                              "reservedContainers": 0,
                                              "reservedResources": {
                                                  "memory": 0,
                                                  "vCores": 0
                                              },
                                              "schedulingPolicy": "fair",
                                              "steadyFairResources": {
                                                  "memory": 320390,
                                                  "vCores": 192
                                              },
                                              "type": "fairSchedulerLeafQueueInfo",
                                              "usedResources": {
                                                  "memory": 103424,
                                                  "vCores": 101
                                              }
                                          }
                                      ]
      

      However, the web UI shows resource types usage.

        Attachments

        1. YARN-7451.010.patch
          246 kB
          Szilard Nemeth
        2. YARN-7451.009.patch
          246 kB
          Szilard Nemeth
        3. YARN-7451.008.patch
          247 kB
          Szilard Nemeth
        4. YARN-7451.007.patch
          236 kB
          Szilard Nemeth
        5. YARN-7451.006.patch
          247 kB
          Szilard Nemeth
        6. YARN-7451.005.patch
          236 kB
          Szilard Nemeth
        7. YARN-7451.004.patch
          236 kB
          Szilard Nemeth
        8. YARN-7451.003.patch
          235 kB
          Szilard Nemeth
        9. YARN-7451.002.patch
          215 kB
          Szilard Nemeth
        10. YARN-7451.001.patch
          215 kB
          Szilard Nemeth
        11. YARN-7451__Expose_custom_resource_types_on_RM_scheduler_API_as_flattened_map01_02.patch
          215 kB
          Szilard Nemeth

          Issue Links

            Activity

              People

              • Assignee:
                snemeth Szilard Nemeth
                Reporter:
                gsohn Grant Sohn
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated: