Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3343

Improve metrics for DN read latency

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.2-alpha
    • datanode
    • None
    • Reviewed

    Description

      Similar to HDFS-3170 on the write side, we should improve the metrics that are generated on the DN for read latency. We should have separate metrics for the time spent in transferTo vs waitWritable so that it's easy to distinguish slow local disks from slow readers on the other end of the socket.

      Attachments

        1. hdfs-3343.patch
          5 kB
          Andrew Wang
        2. hdfs-3343-2.patch
          11 kB
          Andrew Wang
        3. hdfs-3343-3.patch
          10 kB
          Andrew Wang
        4. hdfs-3343-4.patch
          10 kB
          Andrew Wang

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-942 Read and write metrics misleading/not helpful

        • Major - Major loss of function.
        • Open
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-3170 Add more useful metrics for write latency

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            andrew.wang Andrew Wang
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment