Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-12666

Provide cluster performance profiling tool

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.10
    • None
    • Docs Required, Release Notes Required

    Description

      For now, Ignite has not build-in profiling tool for user's operations and internal processes. Such a tool will be able to collect performance statistics and create a human-readable report. It will help to analyze workload and to tune configuration and applications.

      Example of similar tools in other products: AWR [1] [2] [3] (Oracle) ; pgbadger [4], pgmetrics [5], powa [6] (PostgresSQL). Example of html report: powa.

      Attachments

        Issue Links

        is related to

        New Feature - A new feature of the product, which has yet to be developed. IGNITE-10418 Implement lightweight profiling of messages processing

        • Major - Major loss of function.
        • Open
        relates to

        Task - A task that needs to be done. IGNITE-10689 Expose IO statistics for run query

        • Major - Major loss of function.
        • Open
        links to

        Web Link GitHub Pull Request #16

        Web Link GitHub Pull Request #7693

        Web Link WIKI Design

        mentioned in

        Page Loading...

        1.
        		 Provide the ability to profile only specific operations Sub-task Open Nikita Amelchev   Actions
        2.
        		 Provide the ability to cache strings Sub-task Resolved Nikita Amelchev   Actions
        3.
        		 Provide the ability to set up default performance statistics properties Sub-task Resolved Nikita Amelchev   Actions
        4.
        		 Create a new performance statistics file instead of deleting the existing Sub-task Resolved Nikita Amelchev   Actions
        5.
        		 Add documentation for the cluster performance profiling tool Sub-task Resolved Nikita Amelchev

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 3h 40m
        		Actions
        6.
        		 Provide the tool to build cluster performance report Sub-task Resolved Nikita Amelchev   Actions
        7.
        		 Add logical/physical reads checks to existing tests Sub-task Open Nikita Amelchev   Actions
        8.
        		 Provide the utility to output performance statistics operations to the console Sub-task Resolved Nikita Amelchev   Actions
        9.
        		 Remove web-resources from the source of the performance report Sub-task Open Unassigned   Actions
        10.
        		 Remove zip-file with web-resources from the jar Sub-task Open Unassigned   Actions
        11.
        		 Provide the ability to configure performance report Sub-task Open Unassigned   Actions
        12.
        		 Improve log message of start/stop performance statistics collection Sub-task Open Unassigned   Actions
        13.
        		 Optimize memory usage on export performance statistics to JSON Sub-task Open Unassigned   Actions
        14.
        		 Provide the ability to collect CQ performance statistics Sub-task Open Nikita Amelchev

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        		Actions
        15.
        		 Provide the ability to collect Services performance statistics Sub-task Open Nikita Amelchev   Actions
        16.
        		 Added the ability to rotate collecting performance statistics Sub-task Resolved Sergei Ryzhov

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 5h 10m
        		Actions
        17.
        		 Add checkpoint information to the performance statistics. Sub-task Resolved Sergei Ryzhov

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 8h 20m
        		Actions
        18.
        		 Add information about checkpoints to the graphs of the performance statistics report Sub-task Open Unassigned   Actions
        19.
        		 Add rebalance information to the performance statistics Sub-task Patch Available Sergei Ryzhov

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 0.5h
        		Actions
        20.
        		 Update the documentation for the cluster performance profiling tool Sub-task Resolved Sergei Ryzhov

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 1h 10m
        		Actions
        21.
        		 Provide the ability to rollover performance staticstics files Sub-task Resolved Nikolay Izhikov   Actions

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            NSAmelchev Nikita Amelchev Assign to me
            NSAmelchev Nikita Amelchev
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 48h 20m
              48h 20m

              Slack

                Issue deployment