Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13844

Move swift duration stats tracking to hadoop common utils

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 2.9.0
    • None
    • fs/azure, fs/oss, fs/s3, fs/swift
    • None

    Description

      Swift FS has some simple duration counting classes which are used to track HTTP performance, with incremental creation of mean, min, max and variance. These are not moving averages, simply ongoing over time. They've proved useful in detecting which operations are slowest against objects stores. (it turned out to be delete throttling in test teardown BTW, showing the value of the instrumentation)

      By moving them into utils, all the object stores can build up some stats on cost of HTTP operations.

      Attachments

        Activity

          People

            stevel@apache.org Steve Loughran
            stevel@apache.org Steve Loughran
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: