Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2279

Enable metrics logging by default

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.7.0
    • 1.7.0
    • ops-tooling
    • None

    Description

      In a lot of cases, the granular metrics that we collect can be very useful to understand performance problems. Our internal metrics tend to be much more granular than what is supported by common metrics aggregation systems, so having the local metrics log is useful even in the context of a managed deployment. So, I'd like to move towards enabling metrics logging by default.

      Currently, however, the metrics log can be quite verbose, since it's equivalent to dumping all of the /metricsjson endpoint on a periodic basis. Even though we gzip it, we burn a lot of CPU serializing a huge blob (eg /metricsjson is 87MB on a tserver in one of our test clusters). Additionally, we don't currently have the ability to delete old metrics logs automatically, so we'd be in danger of filling up the log dir.

      This JIRA tracks various bits of work on the way to enabling metrics logging by default.

      Attachments

        Issue Links

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: