Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5355 YARN Timeline Service v.2: alpha 2
  3. YARN-5585

[Atsv2] Reader side changes for entity prefix and support for pagination via additional filters

    Details

    • Hadoop Flags:
      Reviewed

      Description

      TimelineReader REST API's provides lot of filters to retrieve the applications. Along with those, it would be good to add new filter i.e fromId so that entities can be retrieved after the fromId.

      Current Behavior : Default limit is set to 100. If there are 1000 entities then REST call gives first/last 100 entities. How to retrieve next set of 100 entities i.e 101 to 200 OR 900 to 801?
      Example : If applications are stored database, app-1 app-2 ... app-10.
      getApps?limit=5 gives app-1 to app-5. But to retrieve next 5 apps, there is no way to achieve this.

      So proposal is to have fromId in the filter like getApps?limit=5&&fromId=app-5 which gives list of apps from app-6 to app-10.

      Since ATS is targeting large number of entities storage, it is very common use case to get next set of entities using fromId rather than querying all the entites. This is very useful for pagination in web UI.

        Attachments

        1. 0001-YARN-5585.patch
          35 kB
          Rohith Sharma K S
        2. YARN-5585.v0.patch
          8 kB
          Rohith Sharma K S
        3. YARN-5585-workaround.patch
          10 kB
          Rohith Sharma K S
        4. YARN-5585-YARN-5355.0001.patch
          23 kB
          Rohith Sharma K S
        5. YARN-5585-YARN-5355.0002.patch
          31 kB
          Rohith Sharma K S
        6. YARN-5585-YARN-5355.0003.patch
          47 kB
          Rohith Sharma K S
        7. YARN-5585-YARN-5355.0004.patch
          73 kB
          Rohith Sharma K S
        8. YARN-5585-YARN-5355.0005.patch
          79 kB
          Rohith Sharma K S
        9. YARN-5585-YARN-5355.0006.patch
          85 kB
          Rohith Sharma K S

          Issue Links

            Activity

              People

              • Assignee:
                rohithsharma Rohith Sharma K S
                Reporter:
                rohithsharma Rohith Sharma K S
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: