Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13844

Move swift duration stats tracking to hadoop common utils

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 2.9.0
    • Fix Version/s: None
    • Component/s: fs/azure, fs/oss, fs/s3, fs/swift
    • Labels:
      None

      Description

      Swift FS has some simple duration counting classes which are used to track HTTP performance, with incremental creation of mean, min, max and variance. These are not moving averages, simply ongoing over time. They've proved useful in detecting which operations are slowest against objects stores. (it turned out to be delete throttling in test teardown BTW, showing the value of the instrumentation)

      By moving them into utils, all the object stores can build up some stats on cost of HTTP operations.

        Attachments

          Activity

            People

            • Assignee:
              stevel@apache.org Steve Loughran
              Reporter:
              stevel@apache.org Steve Loughran
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: