Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6110

adding more slow action log in critical write path

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0, 2.3.0
    • Fix Version/s: 2.5.0
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Log slow i/o. Set log thresholds in dfsclient and datanode via the below new configs:

      dfs.client.slow.io.warning.threshold.ms (Default 30 seconds)
      dfs.datanode.slow.io.warning.threshold.ms (Default 300ms)
      Show
      Log slow i/o. Set log thresholds in dfsclient and datanode via the below new configs: dfs.client.slow.io.warning.threshold.ms (Default 30 seconds) dfs.datanode.slow.io.warning.threshold.ms (Default 300ms)

      Description

      After digging a HBase write spike issue caused by slow buffer io in our cluster, just realize we'd better to add more abnormal latency warning log in write flow, such that if other guys hit HLog sync spike, we could know more detail info from HDFS side at the same time.
      Patch will be uploaded soon.

      1. HDFS-6110v6.txt
        13 kB
        stack
      2. HDFS-6110v5.txt
        11 kB
        Liang Xie
      3. HDFS-6110v4.txt
        11 kB
        Liang Xie
      4. HDFS-6110v3.txt
        11 kB
        stack
      5. HDFS-6110-v2.txt
        10 kB
        Liang Xie
      6. HDFS-6110.txt
        6 kB
        Liang Xie

        Issue Links

          Activity

            People

            • Assignee:
              Liang Xie
              Reporter:
              Liang Xie
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development