Uploaded image for project: 'ZooKeeper'
  1. ZooKeeper
  2. ZOOKEEPER-4289

Reduce the performance impact of Prometheus metrics

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.6.3, 3.7.0, 3.6.2, 3.8.0, 3.7.1
    • Fix Version/s: None
    • Component/s: metric system

      Description

      I have done load comparison tests for Prometheus enabled vs disabled and found the performance is reduced about 40%-60% for both read and write operations (i.e. getData, getChildren and createNode).

      Looked more into this and found that Prometheus Summary is very expensive and there are more than 20 Summary metrics added to the new CommitProcessor.

      Need a solution to reduce the impact of Prometheus metrics.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                liwang Li Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h
                  3h