Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1530 [Umbrella] Store, manage and serve per-framework application-timeline data
  3. YARN-2556

Tool to measure the performance of the timeline server

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      We need to be able to understand the capacity model for the timeline server to give users the tools they need to deploy a timeline server with the correct capacity.

      I propose we create a mapreduce job that can measure timeline server write and read performance. Transactions per second, I/O for both read and write would be a good start.

      This could be done as an example or test job that could be tied into gridmix.

      Attachments

        1. yarn2556_wip.patch
          9 kB
          Chang Li
        2. YARN-2556.1.patch
          12 kB
          Jonathan Turner Eagles
        3. YARN-2556.10.patch
          37 kB
          Chang Li
        4. YARN-2556.11.patch
          37 kB
          Chang Li
        5. YARN-2556.12.patch
          39 kB
          Chang Li
        6. YARN-2556.13.patch
          39 kB
          Chang Li
        7. YARN-2556.13.whitespacefix.patch
          43 kB
          Chang Li
        8. YARN-2556.14.patch
          39 kB
          Chang Li
        9. YARN-2556.14.whitespacefix.patch
          43 kB
          Chang Li
        10. YARN-2556.15.patch
          43 kB
          Chang Li
        11. YARN-2556.2.patch
          11 kB
          Jonathan Turner Eagles
        12. YARN-2556.3.patch
          15 kB
          Chang Li
        13. YARN-2556.4.patch
          19 kB
          Chang Li
        14. YARN-2556.5.patch
          19 kB
          Chang Li
        15. YARN-2556.6.patch
          5 kB
          Chang Li
        16. YARN-2556.7.patch
          19 kB
          Chang Li
        17. YARN-2556.8.patch
          19 kB
          Chang Li
        18. YARN-2556.9.patch
          16 kB
          Chang Li
        19. yarn2556.patch
          10 kB
          Chang Li
        20. yarn2556.patch
          10 kB
          Chang Li
        21. YARN-2556.patch
          12 kB
          Amit Tiwari
        22. YARN-2556-WIP.patch
          8 kB
          Chang Li
        23. YARN-2556-WIP.patch
          8 kB
          Chen He

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4341 add doc about timeline performance tool usage

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue MAPREDUCE-6335 convert load test driver to timeline service v.2

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue MAPREDUCE-6546 reconcile the two versions of the timeline service performance tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-3378 a load test client that can replay a volume of history files

          • Major - Major loss of function.
          • In Progress

          Activity

            People

              lichangleo Chang Li
              jeagles Jonathan Turner Eagles
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: