Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6280

Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Begin from v2.7, the ResourceManager Cluster Applications REST API returns ResourceRequest list. It's a very large construction in AppInfo.
      As a test, we use below URI to query only 2 results:
      http://<rm http address:port>/ws/v1/cluster/apps?states=running,accepted&limit=2
      The results are very different:

      Hadoop version Total Character Total Word Total Lines Size
      2.4.1 1192 42 42 1.2 KB
      2.7.1 1222179 48740 48735 1.21 MB

      Most RESTful API requesters don't know about this after upgraded and their old queries may cause ResourceManager more GC consuming and slower. Even if they know this but have no idea to reduce the impact of ResourceManager except slow down their query frequency.

      The patch adding a query parameter "showResourceRequests" to help requesters who don't need this information to reduce the overhead. In consideration of compatibility of interface, the default value is true if they don't set the parameter, so the behaviour is the same as now.

        Attachments

        1. YARN-6280.001.patch
          8 kB
          Lantao Jin
        2. YARN-6280.002.patch
          13 kB
          Lantao Jin
        3. YARN-6280.003.patch
          13 kB
          Lantao Jin
        4. YARN-6280.004.patch
          13 kB
          Lantao Jin
        5. YARN-6280.005.patch
          13 kB
          Lantao Jin
        6. YARN-6280.006.patch
          13 kB
          Lantao Jin
        7. YARN-6280.007.patch
          13 kB
          Lantao Jin
        8. YARN-6280.008.patch
          15 kB
          Lantao Jin
        9. YARN-6280.009.patch
          15 kB
          Lantao Jin
        10. YARN-6280.010.patch
          23 kB
          Lantao Jin
        11. YARN-6280.011.patch
          26 kB
          Sunil Govindan
        12. YARN-6280-branch-2.001.patch
          23 kB
          Lantao Jin
        13. YARN-6280-branch-2.002.patch
          25 kB
          Lantao Jin

          Issue Links

            Activity

              People

              • Assignee:
                cltlfcjin Lantao Jin
                Reporter:
                cltlfcjin Lantao Jin
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: