Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3343

Improve metrics for DN read latency

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.2-alpha
    • datanode
    • None
    • Reviewed

    Description

      Similar to HDFS-3170 on the write side, we should improve the metrics that are generated on the DN for read latency. We should have separate metrics for the time spent in transferTo vs waitWritable so that it's easy to distinguish slow local disks from slow readers on the other end of the socket.

      Attachments

        1. hdfs-3343.patch
          5 kB
          Andrew Wang
        2. hdfs-3343-2.patch
          11 kB
          Andrew Wang
        3. hdfs-3343-3.patch
          10 kB
          Andrew Wang
        4. hdfs-3343-4.patch
          10 kB
          Andrew Wang

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-942 Read and write metrics misleading/not helpful

          • Major - Major loss of function.
          • Open
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-3170 Add more useful metrics for write latency

          • Major - Major loss of function.
          • Closed

          Activity

            People

              andrew.wang Andrew Wang
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: